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(54) Apparatus for localization of sound image 

(57) A sound image localization apparatus com- 
prises crosstalk canceling means and direction localiz- 
ing means, wherein first the crosstalk canceling means 
first subject an Input sound signal to crosstalk cancella- 
tion, and then, the direction localizing means subject the 
processed signal to directional localizaton, whereby 
both crosstalk cancellation and directional localization 
share a signal to be processed, so the necessary 
amount of a storage device to hold the signal is 
reduced. That is. a reduction in circuit scale and calcu- 
lation load can provide a sound image localization 
apparatus with low cost and high processing precision. 
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Descripti n 

FIELD OF THE INVENTION 

5 The present invention relates to an apparatus for localization of a soimd image and. more particularly, to an appa- 

ratus for localization of a sound innage which receives a sound signal, subjects the sound signal to signal processing, 
localizes a virtual sound irrage. artd outputs a sound image localizaticvi signal. 

BACKGROUND OF THE INVENTION 

10 

A conventional stereophonic system controls sound image localization using a plural of (generally two) loudspeak- 
ers, conferring a realistic sensation to the hearing of a listaier. The conventional system usually includes two laterally 
spaced loudspeakers in front of the listener, so a sound image is localized between them. Outside the two loudspeakers 
no sound image is localized in the system. To obtain the effect that a sourxj image Is localized outside the two loud- 
15 speakers. I.e.. the surround of the listener, for instance, a sound from the back of the listener, the system sometimes 
includes loudspeakers at tiie rear as well as the two loudspeakers in front of the listener. 

The development of technology for digitizing audio and hardware for DSP (Digital Signal Processor) facilitates var- 
ious signal processing. Owing to this, the system using two k)udspeakers in front of the listener can localize a sound 
image at any position around the listener, such as the side and rear of the listener. 
20 The prior art soutkJ image localization apparatus has been discussed in "A Study of Cancellation of Crosstalk Sig- 
nal for Sound Field Control". Collective Papers of Spring Convention of Japanese Acoustical Society. 1996, pp 549-550 
(hereinafter referred to as bibliography 1). 

Rgs. 19(a) and 19(b) are diagrams for explaining about sound image 
localizatbn. Fig. 19(a) shows a sound Image to be localized in a virtual way Fig. 19(b) shows a system using two loud- 
25 speakers. In this case. It is assumed that the positions of virtually localized sound images, and the positions of the two 
loudspeakers are left-and-right symmetrical with respect to the listener. 

In the sound image localization apparatus, a direction of a virtijal position is localized and crosstalk is canceled by 
signal processing using a head related transfer function indicating transfer characteristics of sound from a sound source 
to the listener's head or ear. 

30 Here, in case like Fig. 19(b). a crosstalk signal is a signal transferred from a left loudspeaker to a right ear. or from 
a right Icxjdspeaker to a left ear. A signal is generated for canceling the crosstalk signal. 

In the virtual environment achieved by this system as shown in Fig. 19(a). sound signals uL and uR are radiated 
from the positions of virtual sound images located laterally at tfie back of the listener. Reference numerals. yLI and 
yRI . indicate sound pressures given to left and right ears, respectively. Because of tiie left-and-right symmetry, transfer 

35 of sound from the left virtual position to the left ear is the same as that from the right virtual position to the right ear. 
Ahead related transfer function showing this transfer characteristics is indicated by TM. The transfer of sound from the 
left virtual position to the right ear and that from the right virtual position to the left ear are represented by the same head 
related transf^ function TC. The relation between the sound pressures and the functions are represented by 

40 yLI = TM»uL + TC*uR (1-1) 

and 

yRI = TC • uL + TM • uR (1-2). 

45 

On the other hand, in a system shown in Rg. 19(b). left and right loudspeakers 1901a and 1901b radiate sound 
signals xL and xR, respectively. Sound pressures given to the left and right ears of the listener are yL2 and yR2, respec- 
tively. As they are left-and-right symmetrical, the tiansfer of sound from the left loudspeaker position to the left ear and 
that from the right loudspeaker position to the right ear are represented by tiie same head related transfer function St^. 
50 The t-ansfer of sound from the left loudspeaker position to the right ear and ttiat from the right loudspeaker position to 
the left ear are also represerrted by the same head r^ated transfer function SC. The relation between tiiose sound pres- 
sures and those functions are 

yL2 = Sl^ • xL + SC • xR (2-1) 

55 

and 

yR2 = SC • xL + SM • xR (2-2). 
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In this system, to localize the positions of the sound images shown in Fig. 19(a) using acoustics output from the 
loudspeakers 1901a and 1901b. the following equations must be satisfied. 

yL1=yL2 (3-1) 

5 

and 

yRI = yR2 (3-2). 

10 The equations 3-1 . 1 -1 . and 2-1 lead to the following equation 4-1 , and the equations 3-2. 1 -2. and 2-2 lead to the fol- 
lowing equation 4-2, 

TM • uL + TC • uR = SM • XL + SC • xR (4-1) 

75 and 

TC • uL + TM • uR = SC • xL + SM • xR (4-2). 

The solution to xL and xR is obtained from the equations 4-1 and 4-2. If assumed that, the gain being represented 
20 by 1*1. 



|{SC/SM)^| « 1 (5). 



xL and xR are approxin^ted by 

25 



xL ^ (FM + FC • FX) • uL + (FC + FM • FX) • uR (6-1) 

and 

30 xR ~ (FC + FM • FX) • uL + (FM + FC • FX) • uR (6-2). 

where 

FM =TM/SM (7-1). 

35 

FC=TC/SM (7-2). 

and 

40 FX = -SC/SM (7-3). 

The other solution is possible, that is. 

xL = FM • uL + FC • uR + FX • xR (8-1) 

4$ 

and 

xR = FC • uL -H FM • uR + FX • xL (8-2) 

so are obtained. In the equations 8-1 and 8-2. the first and second terms on the right side indicate the directions of sound 
images, that is, they localize the directions. The third term on the right side cancels a crosstalk component. 

Using the above relations, a conventional sound image localization apparatus is constructed, shown in Fig. 17(a). 
The conventional sound image localization apparatus comprises a crosstalk canceling means 1701. direction localizing 
means 1702a and 1702b. and adders 1703a and 1703b. Sound signals are input through Input terminals 1704a and 

55 1704b, Signals resulting from subjecting the input sound signals to signal processing are output through output termi- 
nals 1705a and 1705b. 

The direction localizing means 1702a and 1702b process tiie sound signals input through the input terminals 
1704a and 1704b to generate signals indicating the directions of sound image positions, respectively The adders 
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1 703a and 1 703b add input signals. The crosstaik canceling means 1701 remove a crosstalk component of an input 
signal. 

Rg. 17(b) is a diagram illustrating an example of detailed structure of the conventional sound image localization 
apparatus- The crosstalk canceling means 1701 shown in Fig. 17(a) comprises crosstalk canceling signal generating 

5 filters 1 706a and 1 706b, and adders 1 703c and 1 703d. The drection localizing means 1 702a and 1 702b shown in Rg. 
17(a) comprise main-path filters 1707a and 1707b. and crosstalk-path filters 1708a and 1708b. respectively. The com- 
bination of the main-path filter and the crosstalk-path filter is sometimes called a direction localizing filter. 

The prior art sound image localization apparatus generates the outputs xL and xR according to the expressions 6- 
1 and 6-2. A description wiD be given of how the sound image localization apparatus works. 

10 Left and right input sound signals are input through the input terminals 1704a and 1 704b, respectively. The first 
input sound signal input through the input terminal 1704a Is input to the main-path filter 1707a and the crosstalk-path 
filter 1708a. The main-path filter 1707a rrujitiplies the input signal by the coefficient shown in the equation 7-1. The 
crosstalk-path filter 1708a multipfies the input signal by the coefficient shown in the equation 7-2. The outputs of the 
main-path fitter 1 707a and the crosstalk-path filter 1 708a are Input to the adders 1 703a and 1 703b, respectively 

75 Similarly, the second input sound signal irput through the input terminal 1 704b is input to the main-path filter 1 707b 
and the crosstalk-path filter 1708b. where the input signal is multiplied by the coefficients expressed by 7-1 and 7-2, 
respectively The outputs of the main-path filter 1 707b and the crosstalk-path filter 1 708b are input to the adders 1 703b 
and 1703a, respectively 

The adders 1 703a and 1 703b each add input signals. The adder 1 703a outputs a result of the addition to the adder 
20 1 703c and the crosstalk canceling signal generating filter 1 706a. The aosstalk canceling signal generating filter 1 706a 
multiplies the input signal by the coefficient represented by the equation 7-3 to produce a crosstalk canceling signal sig- 
nal, and outputs the signal to the adder 1703d. 

Similarly, the adder 1703b outputs a result of the addition to the adder 1703d and the crosstalk canceling signal 
generating filter 1706b. The crosstalk canceling signal gmerating filter 1706b multiplies the input signal by the coeffi- 
25 cient represented by the equation 7-3 to produce a crosstalk canceling signal, and outputs the signal to the adder 
1703c. 

The adders 1703c and 1 703d each add results of addition by the adders 1 703a and 1 703b to the crosstalk cance- 
ling signal having phase almost equivalent to the inversed phase of the result of the addition, respectively. Thus, signals 
represented by the expressions 6-1 and 6-2, of which crosstalk components are rCTioved. are output through the output 
30 terminals 1 705a and 1 705b. respectively. 

In the sound image localization apparatus having the structure shown in Rg. 17(b), the output of a crosstalk can- 
celing signal generating filter on either channel (for example, 1706a) is output to the output side of the other channel 
(the adder 1703d on the side having the output terminal 1705b). This structure is called feedfonward. 

Disclosed is an apparatus, which is a second example realizing the conventional sound image localization appara- 
35 tus, in Japanese Patent Published Application No. Hei 9-233599 (1997) (hereinafter referred to as bibliography 2). 

Rg. 18 is a diagram showing a detailed structure of a second example of the sound image localization apparatus. 
The crosstalk canceling means 1701 in Fig. 17(a) comprises crosstalk canceling signal generating fitters 1806a and 
1806b. and adders 1803a and 1803b. The direction localizing means 1702a and 1702b in Rg. 17(a) comprise main- 
path fitters 1807a and 1807b. and crosstalk-path filters 1808a and 1808b. respectively. The adders 1803a and 1803b 
40 are the same as the adders 1 703a and 1 703b In Fig. 1 7(a), and also part of the crosstalk canceling means 1 701 . 

The sound irrage localization apparatus shown in Fig. 18 generates outputs xL and xR according to the equations 
8-1 and 8-2. With the different structure from that shown in Fig. 17(b), the sound image localization apparatus is called 
a feedback type, because a crosstalk canceling signal generating fitter (for instance, 1806a) on either channel outputs 
a signal to the input side on the other channel (the adder 1803b). A description will be given of how the sound image 
45 localization apparatus operates. 

Left and rigfit input sound signals are input through the input terminals 1804a and 1804b, respectively The first 
input sound, signal input through the input terminal 1804a is input to the main-path fitter 1807a and the crosstalk-path 
filter 1808a. The main-path filter 1807a murtiplies the input signal by the coefficient represented by the equation 7-1. 
and outputs the result to the adder 1d03a. The crosstalk-path filter 1808a nrwltiplies the input signal by the coefficient 
50 represented by the equation 7-2, arKi outputs the result to the adder 1 803b. In a similar way, the right input sound signal 
input through the input terminal 1804b is input to the main-path filter 1807b and the crosstalk-path filter 1808b. where 
the signals are multiplied by coefficients represented by the equations 7-1 and 7-2. and the results are output to tiie 
adders 1803b and 1803a, respectively. 

The adders 1803a and 1803b each add tiie input signals. The adder 1803a outputs a result of the addition to tiie 
55 crosstalk canceling signal generating filter 1806a. The crosstalk canceling signal generating filter 1806a multiplies tiie 
input signal by the coefficient represented by the equation 7-3 to generate a crosstalk canceling signal, and outputs it 
to the adder 1803b. Similarly, tiie adder 1803b outputs a result of the addition to the crosstalk canceling signal gener- 
ating filter 1 806b. The crosstalk canceling signal generating filter 1 806b multiplies the input signal by the coefficient rep- 
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resented by the equation 7-3 to generate a crosstalk canceling signal, and outputs it to the adder 1 803a. 

The adders 1803a and 1803b add the outputs of the direction localizing filter, and further add a result of the addition 
to the crosstalk canceling signal having phase almost equivalent to the inversed phase of the result of the addition, to 
remove a crosstalk conponent. Hence, signals represented by the equations 8-1 and 8-2 are output through the output 
terminals 1 805a and 1 805b. 

As hereinbefore desaibed. in the sound image localization apparatus in accordance with the first embodiment, 
multiple cancellation, in which the generation of a crosstalk canceling signal and the crosstalk cancellation using the 
generated signal are repeated, becomes possible. Ck)mpared with the first example, i.e., the feedfonward type appara- 
tus shown in Fig. 17(a), the adverse effect of sound diffraction of a low-frequency component of a sound signal is 
reduced, thereby solving the first problem of the prior art and improving low-frequency characteristics. 

As described above, the conventional sound image localization apparatus can localize a sound image over a wide 
range by localization of a virtual sound image and compensation of a crosstalk component. However, when trying to 
realize the foregoing sound image localization apparatus by a computer system using a CPU and a DSP, the following 
several problems arise. 

The first problem is about a memory used for tenrporary storage in operational processing. The amount and per- 
formance of a memory in a computer system limit operational procesang. The main constraints on memory are 

(A) constraint on the anrraunt of memory for storage of sound signal data. 

(B) constraint on the amount of memory for storage of coefficients of a fitter, and 

(C) constraint on accessing time of a memory. 

As to (A) and (B). w/hen the nuntjer of words showing the anwunt of memory is small, the number of taps indicating 
the order of a fitter is limited to an insufficient size, resutting in a reduction in precision of operational proc^sing. 

Furthermore, when the amount of a high-speed internal memory included in a computer system is limrted. if a rel- 
atively low-speed external memory (RAM) assists to secure a required precision of operational processing, the problem 
(C) arises. Because frequent memory accesses occur in operational processing realizing the above-described digital 
fitter performing directional localization and crosstalk cancellation, a simple supplement of the external memory having 
a low accessing speed hardly solves the constraint on the amount of memory. 

The second problem relates to a controller included in a computer system, such as DSP The processing speed of 
the controller limtts operaltonal processing. When the processing speed is not sufficient, the order of a digital fitter is 
limited, thereby reducing precision in operational processing. 

The third problem is that rt is diff icutt for the conventional sound image localization apparatus to deal wrth changes 
in setting of an acoustic system using it. The second example of the prior art sound image localization apparatus shown 
in Rg. 18. i.e.. the feedback type, improves the reproducibility of a low-frequency component compared with the feed- 
fonward type. Howwer. when a loudspeaker wrth a small diameter is used in an acoustic system to which the sound 
image localization apparatus is applied, the large energy of the low-frequency range causes sound distortion. If a fitter 
cutting off a low-frequency conponent is adopted to improve this point, the additional fitter increases the drcurt scale 
and the cost. 

Further, when loudspeakers are rearranged in the acoustic system in such a way as that the angle the loudspeak- 
ers attain changes, the conventional sound image localization apparatus modifies an the parameters of the filter FX. 
Thus, to adapt to changes in setting of the acoustic system, parameters for each setting are required to be held. The 
requirement of storage of parameters increases the amount of menrory. 

As the three problems indicate, the prior art sound image localization apparatus has a difficulty in improving low- 
frequency characteristics. Furthermore, when implemented in a computer system, the apparatus requires the large 
amount of memory and the high-speed of processing, thereby making rt difficult to realize both precision of controlling 
sound image localization and a reduction in costs of the computer system. 

SUMMARY OF THE INVENTION 

It is an object of the present invention to provide a sound image localization apparatus realizing sound image local- 
ization wrth good precision while limrting an increase in the circurt scale caused by requirement of the amount of mem- 
ory. 

It is another object of the present invention to provide a sound image localization apparatus realizing sound image 
localization wrth good precfeion by addrtionally exploiting an external memory when the amount of a high-speed internal 
memory is limrted. 

It is still another object of the present invention to provide a sound image localization apparatus realizing sound 
image localization wrth good precision by simplifying operational processing when the computer system does not 
include a high-performance DSP 
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It is yet another object of the pr^nl invention to provide a soureJ image localization af^ratus flexibly coping with 
changes in setting of the acoustic system, without increasing the circuit scale. 

Other objects and advantages of the present invention will become apparent from the detailed description desired 
hereinafter; it should be understood, however, that the detailed descr^jtion and specific embodiment are desired byway 
of Illustration only since various changes and modifications within the scope of the inv^ion will become apparent to 
those skilled in the art from this detailed description. 

Acccwriing to a second aspect of this invention, there is provided the sound image localization apparatus receiving 
a sound signal, performing signal procesang to the sound signal, localizing a virtual sound image, and outputting a 
sound image localization signal, the apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal, and performing crosstalk cancellation using 
the crosstalk canceling signal ; and 

direction localizing means for localizing the direction of a virtual sound source position by processing the signal 
subjected to crosstalk cancellation in the crosstalk canceling means. 

As a result, the apparatus first performs crosstalk cancellation to an input sound signal, and then, performs direc- 
tional localization to the sound signal. 

According to a second aspect of this invention, there Is provided the sound image localization apparatus of the first 
aspect wherein 

the crosstalk canceling means comprise first and second crosstalk canceling signal generating filters, and first and 
second adders, the first adder adding a first sound signal and a signal generated by the second crosstalk canceling 
signal generating filter, and the second adder adding a second sound signal and a signal generated by the first 
crosstalk canceling signal generating filter; 

the direction localizing means comprise first and second main-path filters, first and second crosstalk-path filters 
and first and second adders, the first adder adding a signal processed by the first main-path filter and a signal proc- 
essed by the second crosstalk-path filter, and the second adder addng a signal processed by the second main- 
path filter and a signal processed by the first crosstalk-path filter. 

As a result the apparatus first performs aosstalk cancellation to an input sound signal using a signal generated by 
a crosstalk canceling signal generating filter, and then, performs directional localization to the sound signal using a 
main-path filter and a crosstalk-path filter. 

According to a third aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means for including a comb filter to generate the crosstalk canceling signal, and performing 

crosstalk cancellation using the crosstalk canceling signal; and 

direction localizing means for localizing the direction of a virtual sound source position. 

As a result, the apparatus pertbnns crosstalk cancellation using a signal generated by a crosstalk canceling signal 
generating filter including a comb filter of which the coefficients are the same. 

According to a fourth aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal generated at a certain time, holding the 
crosstalk canceling signal, delaying the crosstalk canceling signal held, holding the plurality of crosstalk canceling 
signals delayed, and multiplying some of the plurality of crosstalk canceling signals held by a predetennined coef- 
ficient to generate the crosstalk canceling signal at a time following the certain time; and 
direction localizing means for localizing the direction of a virtual sound source position. 

As a result, the apparatus performs crosstalk cancellation using a singal generated a crosstalk canceling signal 
generating filter including a circuit replacing a comb filter, of which the processing load is reduced. 

According to a frftfi aspect of this invention, there is provided ttie sound image localization apparatus of any of the 
third and fourth aspects wherein 

the apparatus further comprises a low-pass filter processing a signal input to or output from the crosstalk canceling 
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means. 

As a result the apparatus performs crosstalk cancelation to a signal, of which a high-frequency component is 
removed, using a singal generated a crosstalk canceling signal generating filter including a comb filter or a circuit 
replacing a comb filter. 

According to a sixth aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal/performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk cance- 
ling signal, and a switch switching the crosstalk canceling signal generated by the aosstalk canceling signal gen- 
erating filter to the output side of the crosstalk canceling signal generating filter or to the input side of the crosstalk 
canceling signal generating filter; and 

direction localizing means for localizing the direction of a virtual sound source position. 
As a result, the apparatus switches feedback processing and feedfonward processing. 

According to a seventh aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk cance- 
ling signal, and a delaying unit delaying a signal Input to or output from the crosstalk canceling signal generating 
filter by various times; and 

direction localizing means for localizing the direction of a virtual sound source position. 

As a result, the apparatus performs crosstalk cancellation by changing the amount of an initial delay 
According to an eighth aspect of this invention, there is provided a sound image localization apparatus receiving an 
input sound signal to be localized in a first direction, and an input sound signal to be localized in a second direction, 
performing signal processing to the input sound signals, localizing virtual sound images, and outputting sound image 
localization signals, the apparatjs comprising: 

crosstalk canceling means conrprising a first filter, a second fitter, and a switch switching first and second nrxxJes; 
in the first mode the first filter functioning as a filter generating the crosstalk canceling signal, and In the second 
mode the second filter functioning as a filter generating tiie crosstalk canceling signal while tiie first filter functioning 
as a fitter localizing the second direction; and 

direction localizing means for localizing the direction of a virtual sound source position. 

As a result, a aosstalk canceling signal generating filter for localizing a sound image to be localized in a first direc- 
tion, and a crosstalk canceling signal generating filter for localizing a sound image to be localized in a second direction, 
are switched. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1(a) and 1(b) are block diagrams showing structures of a sound image localization apparatus in accordance 
with a first embodiment of this invention. 

Fig. 2 Is a diagram showing an example of a structure of a filter included in the sound image localization apparatus 
of the first embodiment. 

Fig. 3 Is a diagram showing an example of a structure of a filter Included in the sound image localization apparatus 
of the first embodiment. 

Fig. 4 is a block diagram showing a structure of an application example of the sound image localization apparatus 
of tiie first embodiment. 

Fig. 5 is a block diagram showing a structure of a sound image localization apparatus in accordance with a second 
embodiment of this invention. 

Fig. 6 Is a block diagram showing a structure of an application example of the sound image localization apparatus 
of tiie second embodiment. 

Figs. 7(a) and 7(b) are graphs showing frequency characteristics of a filter used in the second embodiment to 
explain how tiie filter works. 

Fig. 8 is a block diagram showing a structure of an application example of the sound image localization apparatus 
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of the second embodiment 

Rg. 9 is a block diagram showing a structure of an application example of the sound image localization acoaratus 
of the second embodiment 

Rg. 10 is a block diagram showving a structure of an application example of the sound Image localization apparatus 
of the second embodiment 

Rg. 11 is a block diagram showing a structure of a sound image localization apparatus in accordance with a third 
embodiment of this inverrtion. 

Rg. 1 2 is a block diagram showing a structure of a sound image localization apparatus In accordance with a fourth 
embodiment of this invention. 

Rg. 1 3 is a block diagram showing a structure of an application example of the sound image localization aDoaratus 
of the fourth emtK)diment 

Rg. 1 4 is a block diagram showing a structure of an application example of the sound image localization apparatus 
of the fourth embodiment 

Rg. 15 is a block diagram showving a structure of a sound image localization apparatus in accordance with a fifth 
15 embodiment of this Invaition. 

Rg. 16 is a block diagram showing a structure of a sound image localization apparatus in accordance with a sixth 
entxxJiment of this invention. 

Rgs. 1 7(a) and 1 7(b) are block diagrams showving structures of a first example of a prior art sound Image localiza- 
tion apparatus. 

Rg. 18 is a block diagram showing a structure of a second exanple of a prior art sound image localization appara- 
Rgs. 19(a) and 19(b) are diagrams for explaining sound image localization. 
DETAILED DFRHRIP TION OF THE PREFERRED EMBQDIMEMTR 
[Embodiment 1] 

A sound image localization apparatus in accordance with a first en*odiment of this invention reduces the neces- 
sary amount of memory by subjecting a signal to directional localization after performing crosstalk cancellation to the 
30 signal. 

Rg. 1 (a) is a block diagram showing a structure of the sound image localization apparatus of the first embodiment 
As shown in the figure, the sound image localization apparatus comprises a crosstalk canceling means 101 . and direc- 
tion localizing means 102a and 102b. adders 103a and 103b. The apparatus receives Input sound signals through input 
t^minals 1 04a and 104b, subjects the Input signals to signal processing, and outputs the resulting signals through out- 
35 put terminals 105a and 105b. 

The crosstalk canceling means 101 removes aosstalk components from the input signals input through the input 
terminals 104a and 104b. The direction localizing means 102a and 102b process input sound signals to produce sig- 
nals indicating the directions of sound Imagea The adders 1 03a and 1 03b add input signals. 

The operational processing of the sound image localization apparatus will be explained. Initially, in addition to the 
40 equations 1-1 to 8-2 shown in the BACKGROUND OF THE INVENTION and Embodiment 1 sections vL and vR are 
defined by 



20 



25 



(9-1) 



(9-2). 



xL = FM • vL + FC • vR 

45 and 

xR = FC • vL + FM • vR 
Th equation 9-1 is substituted to the equation 8-1 , and 9-2 Is substituted to 8-2 and then 

50 

FM • vL + FC • vR = FM • uL + FC • uR + FX • (FC • vL + FM • vR) (10-1) 

and 

FC • vL + FM • vR = FC • uL+ FM • uR + FX • (FM • vL + FC • vR) (10-2) 
are obtained. From 10-1 and 10-2. FM and FC are eliminated, and then 
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vL = uL+ FX*vR 

and 

5 vR = uR+FX-vL (1^-2) 

are obtained. 

The equations 1 1 -1 and 11 -2 mean that a crosstalk canceling means is required to be set up on the input side. The 
equations 9-1 and 9-2 mean that direction localizing means are required to be set up on the output side. Accordingly. 
10 the sound image localization apparatus of the first embodiment as shown in Fig. 1(a). includes a crosstalk canceling 
means 101 on the input side, and direction localizing means 102a and 102b on the output side. 

Fig. 1(b) is a diagram showing a detailed structure of a first example of the sound image localization apparatus of 
the first embodiment. The crosstalk canceling means 101 shown in Fig. 1 (a) comprises crosstalk canceling signal gen- 
erating filters 106a and 106b. and adders 103c and 103d in Fig. 1(b). The direction localizing means 102a and 102b 
15 Shown in Fig. 1(b) comprise main-path filters 107a and 107b, and crosstalk-path fitters 108a and 108b in Rg. 1(b). 
respectively. An explanation will be given of the operation of the first example of the sound image localization apparatus. 

Left and right input sound signals uL and uR are input through input terminals 104a and 104b. In Fig. 1(b). the first 
input sound signal uL input through the input terminal 104a is input to the adder 103c. The right input sound signal uR 
input through the input terminal 104b is input to the adder 103d. Immediately after the sound image localization appa- 
20 ratus starts processing, the crosstalk canceling signal generating filters 1 06a and 1 06b don't generate any signals to be 
output to the adders 1 03c and 1 03d. so the adders 1 03c and 1 03d output input signals uL and uR as they are. The sig- 
nals uL and uR are input to the crosstalk canceling signal generating filters 106a and 106b as signals vL and vR. 
respectively. 

The crosstalk canceling signal generating filter 106a multiplies the input signal by the coeffid^ having a negative 
25 sign represented by the equation 7-3 to produce a crosstalk canceling signal, and outputs it to the adder 103d. The 
crosstalk canceling signal generating filter 106b performs a similar processing to produce a crosstalk canceling signal, 
and outputs it to the adder 103c. 

The adder 1 03c adds the input sound signal uL and the crosstalk canceling signal to perform crosstalk cancellation, 
gen^ating the signal vL represented by the equation 1 1 -1 . The generated signal vL is input to the main-path filter 107a 
30 and the aosstalk-path fitter 108a. In a similar manner, the adder 103d generates the signal vR represented by 11-2. 
which is input to the main-path filter 107b and the crosstalk-path filter 108b. 

The main-path filter 107a multiplies the input signal by the coefficient represented by the equation 7-1 , and outputs 
the result to the adder 103a. The crosstalk-path filter 108a multiplies the input signal by the coefficient represented by 
the equation 7-2. and outputs the result to the adder 1 03b. The output of the main-path filter 1 07a is represented by the 
35 first temi on the right side of the equation 9-1 . The output of the crosstalk-path fitter 1 08a is represented by the second 
term on the right side of the equation 9-2. 

Similarly, the adder 1 03d adds the crosstalk canceling signal to the input sound signal uR to perform crosstalk can- 
cellation. The resulting signal vR is input to the main^th filter 107b and the crosstalk-path filter 108b. where tiie signal 
is multiplied by the coefficients represented by the equations 7-1 and 7-2, respectively. The outputs of the main-path 
40 filter 107b and the crosstalk-path filter 1 08b are input to the adders 1 03b and 1 03a. respectively. The output of the main- 
path filter 107b is represented by the first temi on the right side of the equation 9-2. The output of the crosstalk-path 
filter 108a is represented by the second term on the right side of the equation 9-1 . 

The adders 103a and 103b each add input signals, and output results of the addition through the output terminals 
105a and 105b. respectively. Thus, the sound image localization apparatus in accordance with the first embodiment 
45 outputs signals xL and xR processed by directional localization, represented by the equations 9-1 and 9-2. 

As described above, in the sound image localization apparatus in accordance with the first embodiment, because 
signals are subjected to aosstalk cancellation prior to directional localization, as shown in Fig. 1(b). the inputs of the 
crosstalk canceling signal generating filter (FX) and the direction localizing filter (FM and FC) are the same signal, vL 
or vR. Thus, for filtering, just those two signals are required to hold. Conpared with the conventional sound image local- 
50 ization apparatus shown in Figs. 1 7(b) and 1 8, required to hold four kinds of signals, the amount of memory required to 
hold sound signals, described as the first problem in the BACKGROUND OF THE INVENTION section, can be reduced 
to a small size. 

To explain the required amount of memory in the apparatus of the first emfcwxliment. each structure of filters for 
crosstalk cancellation and directional localization will be shown. 
55 There are two sorts of filters. FIR (Finite Impulse Response) accumulating input signals and IIR (Infinite Impulse 
Response) accumulating output signals as well as input signals. Either of the two kinds of filters can realize the sound 
image localization apparatus of the first emtxxJiment. Fig. 2 is a diagram showing the first example of the apparatus in 
which the crosstalk canceling signal generating filters 106a and 106b. and ttie direction localizing fflters 107a, 107b. 
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il^RR ,ira^\'„'?.Sr.'''' ' ^^^-^ each ffter shown in Fig. 1(b) is the concatenation 

In Fig. 2. the crosstalk canceling signal generatng filter I06a included in the first example (Fig 1(b)) of the sound 
SU'^t'^r^T- ""^['^^^-'-^•"S and 1 llcto lllf. multiplier 110x1 to noxs"^ anSS 

9^"«ra«"9 'Wer 106b comprises delaying units 1 1 lb and 1 1 1 g to 1 1 1j multiplleis 
o ?Sx5 I^Z'S^ 2 ^^^^-^^^ ^•^^ dashed lines, such as tSe mufti^li^TtoT 

to 1 1 0x5 and the delaying unrts 1 1 1 c to 1 1 1 f. show that the number of multipliers or delaying units is variaWe 

ThP m»!„T^l"^ ""^ 111c to lllf, multipliers 110ml to llOmS. and an adder 103e 

c^stalk^jath filter 108a comprises delaying units 1 1 1c to 1 1 1f and 1 1 1n to 1 1 1p. multipliers 1 lOcI to 1 10c5 and an 
t^l^^lO^ar^^n'^n^^^ 

ing units 1 1 1 k to 1 1 1p are enployed to produce the time difference between both ears 

dire<£M^^rnrfS; ^ '"^"^T^ '"'^''"^ units 1 1 1 c to 1 1 1j. the aosstalk canceling signal generating filer and the 
direction local«,ng filter receive the same input signals, as signals vL or vR shown in Fig. 1(b). Hence compared with 
the ^se where the input of each filter is held, it is possible to reduce the amount of mei^n^ requSo^S^T 

"2a and 1 12b. A main-path fiHer comprises IIR filter FIWIIs 1 13a and 1 13b A crosstalk-oath fittercom 
pns^llRfiHerFCIs 114a and 114b. "mose MR filters are concatenated with the FIR fi«e,; ^.^n ngT 
^JI^ ^S^H '^'"-P^"'*^^- ^ crosstalk-pathfflter. and thecrosstalk canceling signal generating filter, con- 



FM = FMF . FMI ^^g-l) 
FC=FCF.FCI (12-2). 



ard 

FX = FXF . FXI 



(12-3). 



nnJlS't " !lif ^""^ *° ^^'^ 2- ^ FIR filter portions share an input, thereby making it 

S^i^oT^e^FlZr^^^ 

.ihnu^^inV^ a diagram linking a second example of a detailed structure of a sound image localization apparatus 
irJ^ ^^S.^^Z^T^'^ AS Shown in the figure, the second example of^J^uS 

iS rSS^^H^^"^ ^"^"^^ ^'^'^''^ *° '^"^"^ '^'''^ s'Sna' generatingTilters 106a and 
SS'^ kI^!^ ^^'^ "o^^a'X-PathfOters 108a and 108b. high-frequency main-paS, filters 1178 aS 

in S I^SrL*:::^"^ ' ' ''^-.^'^ '^'^ "^"^"^ Circuits 1 1 6a and V;6b. /4 in theTrst exampleS^ 
m andSl rTfjr^ ""P"* '"»^ '^"""^ 104a and 1 04b. and subjected to signafprocess- 

ing. and the resultng signals are output through the output terminals 105a and 105b ^ 

The subsampling circuits 115a and 115b subject input signals to prescribed subsampling to produce a low-fre- 
2is to ^^h!? ^ ^'jSh-frequency component The band compositing circuits 1 16a and 1 16b subject input sig- 
nals to prescribed composition to produce composite signals. The high-frequency main-path filters 117a and 11^ 
operate inasimilarwaytothemain-pathfiHers 107aand 107b. The adders 103ato 103d. thTcrosstalkcancelinTsLna^ 

des^bed^^"*" ^^"^ ^"^'^ °* ^ '"^^^ localization apparatus of the first en*odiment wfll be 

■nn,i'H!r'^^'iS[*^'T!f°'^^'^"^'^*'®'"P^*™'^^*^ 104b. The fiist input sound signal 

input ttirough the inputterminal 104a is input to the subsampling circuit 115a. The subsampling clroS 115a SSm 

uZ^e^tm^'::i':^^'T "^^"^ « low-trequency comp^ent' and outpS S^- 

^uer^ component to the high-frequency main-path filter 1 1 7a. and the low-frequency component to the adder 103c 
The subsampling circuit 11 5b operates in a similar way. -h" «ni me aaaer ludc. 

The high-frequency main-path filters 117a and 117b multiply the input high-frequency components by the coeffi- 
'2?eS^eT ' *° '^"^ ^mpJtingXiiL 1 1 ar^?^. 
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The Icjw-frequency component of the input sound signal is subjected to crosstalk cancellation and directional local- 
ization in a similar manner tothefirst example, and the resutting signals are input to the band compositing arcuits 1 15a 
and 1 1 5b respectively. The band compositing circuits 1 1 5a and 1 1 5b composrte a signal resulting from processing the 
high-frequency component with the high-frequency filter, and a signal resulting from processing the low-frequency com- 

5 ponent by directional localization after crosstalk cancellation, and output the composite signals through the output ter- 
minals 105a and lOSb. respectively. 

As is clear from the above, a second example of the sound image localization apparatus subjects only the low-fre- 
quency component of the input signal to crosstalk cancellation. In general, the high-frequency component of an input 
signal is seriously affected by a sHght shift of the head of a listener and differences among individuals, so that the benefit 

10 of crosstalk cancellation is little for the high-frequency component. Therefore, a second example of the sound image 
localization apparatus processes the high-frequency component only with the main-path filter. Thus, because the target 
of crosstalk cancellation is only the low-frequency component, the number of sampling frequency can be reduced^ 
thereby making it possible to make the sizes of filter circuits in Figs. 3 and 4 smaller without reducing the preasion of 

sound image localization. . ^ .. , ,• ^ 

15 As hereinbefore pointed out, the sound image localization apparatus in accordance with the first embodiment, as 
shown in Fig. 1(a). comprises a crosstalk canceling means 101 on the input side, and direction localizing means 102a 
and 102b on the output side. Thereby, each filter included in the crosstalk canceling means 101 and the direction lo<^l- 
izing means 102a and 102b shares an input signal by using delaying units as shown in Figs. 2 and 3. As a result, the 
amount of memory required to hold a sound signal is reduced while sound image localization can be saUsfactory. 
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[Emtxxliment 2] 

A sound image localization apparatus in accordance wHh a second embodiment of this invention employs a comb 

25 '"^"^Fig 5 is a block diagram showing a structure of a first example of the sound image localization apparatus of the 
second ent)odiment. The outline of the structure of the sound image localization apparatus is similar to the structure of 
the feedback type apparatus in the prior art shown in Fig. 18. As shown in Fig. 5. the sound image localization appara- 
tus comprises adders 503a. 503b, 503e. and 503f. main-path filters 507a and 507b. crosstalk-path filters 508a and 
508b delaying units 51 1 a to 51 Ij. and muttipliers 51 0x1 to 51 0x1 0. Input sound signals are input through input termi- 
nals 504a and 504b. and subjected to signal processing, and the resulting signals are output through output terminaJs 
505a and 505b. As in Fig. 2 and so on, dashed lines on rows of the delaying units and the multipliers represent an arbi- 
trary number of the delaying units and the multipliers in Fig. 5. -^CH 

In Fig. 5. the crosstalk canceling signal generating filter 1 06a shown in Fig. 1 8 comprises the delaying units 511 a^ 
51 1 c to 51 If. the multipliers 510x1 to 510x5. and the adder 503e. The crosstalk canceling signal generating filter 1 06b 
shown in Fig. 18 comprises the delaying units 51 lb. 51 1g to 51 Ij. the multipliers 510x6 to 510x10. and the adder 503f. 
All the coefficients of the multiplier 510x1 to 510x10 are possible to be the same, which makes the filter a *ype- 
Therefore, when using a comb filter, it is possible to reduce the amount of memory, required to hold the coefficient. 
desCTibed in the BACKGROUND IN THE INVEfMTION section, as the first problem (B). 

The operation of the sound image localization apparatus of the second embodiment is similar to that of the feed- 
40 back type sound image localization apparatus of the first emtxxliment. ,. ^ ^ 

Figs. 7(a) and 7(b) are graphs for explaining frequency characteristics of a filter. Rg. 7(a) shows amplitude charac- 
teristics. Rg. 7(b) indicates phase characteristics. In either figure, a solid line represents charactenstics of the comb W- 
ter used in the second embodiment, and a dashed line represents characteristics obtained from the ratio of head related 
transfer functions. In general, a comb filter has linear phase type low-pass characteristics. As is apparent from the fig- 
45 ure. both the characteristics are similar to each other in a low-frequency range of the amplitude and phase characteris- 
tics. As descrtoed in the first embodiment, cancellation is partcularly effective in a low-frequency range of a sound 
signal. Because the characteristics of the comb f ilter is approximate to that obtained from the head related transfer func- 
tion in the low-frequency range, the combfiKer operates well for the low-frequency range. For a high-frequency range 
in which the two characteristics differ, aosstalk cancellation is hardly effective, so the influence of differences between 

so the two characteristics is little. . * « «. 

Rg 6 is a block diagram showing a structure of a second example of the sound image localization apparatus of the 
second embodiment. As shown in Fig. 6. this example includes a first example of the sound image localizaton appara- 
tus and further comprises low-pass f Uters 620a and 620bL The low-pass filter 620a comprises an adder 603c. '™ft'P''- 
ers 610f1 and 610f2. and a delaying unK 61 1a The low-pass fitter 620b comprises an adder 603d. multipliers 610f3 and 

55 610f4. and a delaying unit 61 1b. _x • ■ v.r^rft» 

As to the operation of the sound image localization apparatus, the high-frequency components of signals input to 
the crosstalk canceling signal generating filters 106a and 106b shown in Fig. 18 are removed, and the other operaton 
is similar to that of the first example. As hereinbefore pointed out. in generating a crosstalk canceling signal, the high- 
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frequency component of a sound signal is not necessarity taken into consideration. In this example, the high-frequency 
component is not the target of processing, thereby making it possflole to improve the precision of sound localization bet- 
ter than the first example. Note that the scale of the circuit of the second example becomes slightly larger than that of 
the first example by the low-pass fitter. 

Although in the second example the low-pass filter Is disposed in front of the crosstalk canceling signal generating 
filter, i.e., on the input side, the low-pass fitter can be disposed at the rear of the crosstalk canceling signal generating 
filter, i.e., on the output side, thereby making possible the same effect 

Rg. 8 is a diagram showing a structure of a third example of the sound image localization apparatus of the first 
embodiment. As shown in the figure, this example enploys a con* filter, similar to that in the first example, but having 
FIRs of which the number of taps is small. In the structure slwwn in Fig. 8. the number of taps is two, and all the coef- 
ficients can be set to. for instance. -0.46. In this case, the filter becomes a filter having linear phased low-pass charac- 
teristics. This sound image localization apparatus operates in a similar way to the first example. 

In an acoustic system using the sound image localization apparatus, when the distance between two loudspeakers 
is set to be short, for example, the angle the loudspeakers attain is 10 to 20 degrees, the ratio of head related transfer 
functions shown in Rg. 19(b). i.e.. SC/SM. becomes close to 1. Therefore, considering the stability of sound image 
localization, and a reduction in a high-frequency component due to the sound diffraction of a sound signal, a filter hav- 
ing a small number of taps has good approximation in this case. In the case, the apparatus having the structure shown 
in Rg. 8 can reduces the amount of memory required to store the coefficient further than the first example shown in Rg. 
5. As a result, the amount of data held by the delaying unit becomes small, and it is possible to make the scale of the 
circuit smaller. 

Rgs. 9 and 1 0 are diagrams showing a structure of a fourth example of the sound image localization of the second 
embodiment. As shown in Rg. 9, this example of the sound image localizatbn apparatus includes a third exarrple of 
the apparatus, and further comprises high-frequency main-path faters 917a and 917b. sut>sampling circuits 915a and 
915b. and band conpositing circuits 916a and 916b. These are similar to those shown in the second example of the 
first embodiment, i.e.. the high-frequency main-path filters 117a and 117b, the sut>samp!ing circuits 1 15a and 115b, and 
the band compositing circuits 1 16a and 1 16b. The same with high-frequency main-path filters 1017a and 1017b. sub- 
sampling drcurts 1015a and 1015b, and band compositing circuits 1016a and 1016b. shown in Fig. 10. 

As to the operation of this example of the sound image localization apparatus, subsampling and band conposition 
are similar to those in the first embodiment, and the other processes are similar to those in the second embodiment 
Therefore, similar to the second example in the first embodiment and the third example in the first embodiment this 
example of the sound image localization apparatus can reduce the required amount of memory and make the scale of 
the circuit smaller. 

The crosstalk canceling signal generating filter as the FIR fitter having two taps similar to the third example is dis- 
posed between the direction localizing filter and the band compositing drcuit in the structure shown in Fig. 9. while 
bang disposed at the rear of the band compositing circuit, i.e., on the output side, in the structure shown in Fig. 10. 
However, the crosstalk canceling signal generating filter may be disposed in front of the subsampling circuit, i.e., on the 
input side, or between the subsampling circuit and the direction localizing m&, and may receive only the low-frequency 
conrponent output from the subsampling circuit as the target of processing, resulting in the similar effect 

As described atwve, the sound image localization apparatus in accordance with the second embodiment includes 
the comb filters in which the coefliderrts of the multipliers 510x1 to 510x10 shown in Rg. 5 are the same, whereby the 
operation using the filters requires only one parameter, i.e., the coefficient, and therefore, the amount of memory for 
holding the coefficient is reduced while making possible a high level of sound image localization. 

Although in the second embodiment the outline of the structure is the same as the feedback type sound image 
localization apparatus shown in Fig. 18, the feedfonward type sound image localization apparatus shown in Fig. 17(b) 
may be used, or a comb f ater can be used for the sound image localization apparatus of the first emlxxliment shown in 
Fig. 1(b), resulting in the same effect. 

[Embodiment 3] 

A sound image kxalization apparatus in accordance with a third embodiment of this invention enploys a circuit 
including delay buffers and accumulation registers (or memories) instead of corvb filters of the second embodiment. 

Rg. 11 is a block diagram showing a structure of the sound image localization apparati^ of the third embodiment. 
The outline of the structure of the sound image localization apparatus of the third embodiment indudes the same feed- 
back structure as the prior art shown in Rg. 18. similar to the second embodiment. As shown in Fig. 1 1 , the sourxl 
image localization apparatus comprises adde-s 1 103a, 1103b. 1103c, and 1103d. main-path fitters 1 107a and 1107b, 
crosstalk-path filters 1108a and llOa), delaying units 1111a to llllj. and muttipliers 1110f1 to 1110f4. 1110x1, 
1 1 1 0x5. 1 1 1 0x6, and 1 1 1 0x1 0. Input sound signals are input through input terminals 1 1 04a and 1 1 04b, and subjected 
to signal processing, and the resulting signals are output through output terminals 1105a and 1105b. As in Fig. 2, 
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dashed lines in the rows of the delaying units represent an arbitrary number of the delaying units. 

In the figure, the portion including the adder 1 103c. the nrwltipliers 1 1 lOf 1 and 1 1 10f2, and the delaying unit 1111m. 
and the portion including the adder 1103d. the multipliers 111013 and 1110f4. and the delaying unit 1111n constitute 
low-pass filters similar to that in the second example of the second embodiment. In place of the comb filters constituting 

5 the crosstalk canceling signal generating filters (1806a and 1806b in Fig. 18). the delaying units 1111a. 1111b. 1111c 
to 1 1 1 1f, and 1 1 1 1 g to 1 1 1 1j. the multipliers 1 1 10x1 . 1 1 10x5. 1 1 1 0x6. and 1 1 10x10. and the adders 1 1 03e to 1 1 03h 
are included in the sound image localization apparatus of the third embodiment. 

The comb filter included in the apparatus of the second embodiment shown in Fig. 5 performs the operation equiv- 
alent to calculating the average of data held in the delaying units 51 1c to 51 If at a time so as to generate a aosstalk 

10 canceling signal at the time. Accordingly, based on the aosstalk canceling signal obtained at a certain time, the oldest 
among the data is reduced to one n-th, and one n-th of the newest data is added to the data. Thereby, a crosstalk can- 
celing signal at a next time is obtained. 

In the sound image localization apparatus shown in Rg. 1 1 , the delaying units 1 1 1 la and 1 1 1 lb hold immediately 
previous signals. Among data held by the delaying units 1 1 1 1 c to 1 1 1 1f and 1 1 1 lg to 1 1 1 1j. the oldest data. i.e.. the 

15 data held in the delaying units 1 1 1 1f and 1 1 1 1j having maximum delay in Fig. 1 1 . are multiplied by one n-th in the mul- 
tipliers 11 10x5 and 1 1 10x10, and the results are subtracted from the immediately previous signals by the adders 1 103g 
and 1 1 03h. respectively. Among the data held by the delaying units, the newest data, i.e., the data held in the delaying 
units 1111c and 111 1g having minimum delay in Fig. 11. are murtiplied by one n-th in the multipliers 1110x1 and 
1 1 10x6. and the results are added to the results of the subtraction by the adders 1 103e and 1 103f. The results of the 

20 additiori are crosstalk canceling signals similar to that is obtained from the operation of the comb filter. The generated 
signals are held by the delaying units 1111a and 1 1 1 1 b to generate signals at a next time. 

In the sound image localization apparatus of the third embodiment, the data held in the delaying units 111 1c to 
1 1 1 1f and 1 1 1 1g to 1 1 1 1j are accessed only when the oldest data are taken and when the newest data are written. 
Since the delaying unit included in the comb filter of the second embodiment is frequently accessed, a high-speed 

25 memory is required. In contrast, a relatively low-speed memory can be employed for the delaying unit included in the 
third ent)odiment. The amounts of multiplication and addition are further reduced in the third embodiment than in the 
second embodiment. Thus, the sound image tocalization apparatus in accordance with the third embodiment solves the 
access time problem of a memory, i.e.. (C) of the first problem, and the processing speed problem, i.e.. the second 
problem. 

30 As explained above, the sound image localization apparatus of the third embodiment includes delay buffers (the 
delaying units 1 1 1 1c to 1 1 1 1f and 1 1 1 1g to 1 1 1 1j in Rg. 1 1) and accumulation registers (the delaying units 1 1 1 la and 
1 1 1 lb in Fig. 1 1) as filters for crosstalk cancellation in place of the comb filter. Thereby, the incidence of access to a 
memory, and the loads of addition and multiplication are reduced. As a result in a computer system implementing the 
sound image localization apparatus, even when the amount of a high-speed memory and the processing speed of a 

35 processor are limited, a high level of sound image localization is possible. 

Similar to the first embodiment the outline of the structure in the third embodiment is the same feedback type 
sound image localization apparatus as shown in Rg. 18. However, the feedfonward type apparatus shown in Fig. 17 (b) 
is possible, and a circuit sul>strtuting the comb filter can be employed in the apparatus of the first embodiment shown in 
Fig. 1(b). 
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[Embodiment 4] 



A sound image localization apparatts in accordance with a fourth embodiment of this invention can localize a 
sound image by switching the apparatus to feedfonward or feedback. 

45 Fig. 1 2 is a diagram showing a structure of a first example of the sound image localization apparatus of ttie fourth 

emtKxdiment. As shown in the figure, the sound image tocalization apparatus comprises the apparatus shown in Fig. 18 
and, further, adders 1203c and 1203d. and switches 1218a and 1218b. 

Fig. 1 2 shows a case where the swvitches 1 21 8a and 1 21 8b both turn to feedtack (an FB side in the figure). In this 
sHuation. crosstalk canceling signals generated by aosstalk canceling signal generating filters 1206a and 1206b are 

so input to the adders 1 203a and 1 203b. That is. the crosstalk canceling signal is output to the input side, so the apparatus 
is a feedback type, and is equivalent to the apparatus shown in Fig. 1 8. In this case, the apparatus of the fourth embod- 
iment operates in a similar way to the apparatus of the second example in the BACKGROUND IN THE INVENTION 
section. 

As opposed to this, when the switches 1218a and 1218b both turn to feedfonward (an FF side in the figure), cross- 
55 talk canceling signals generated by crosstalk canceling signal generating filters 1206a and 1206b are input to the 
adders 1 203c and 1 203d. That is. the aosstalk canceling signal is output to the output side, so the apparatus is a feed- 
fonward type, and equivalent to the apparatus shown In Rg. 1 7(b). In this case, the apparatus of the fourth embodiment 
operates in a similar way to the apparatus of the second example in the BACKGROUND IN THE INVENTION section. 
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In general, the feecft>ack type apparatus has good reprodudbility of the low-frequency component. However, as 
described about the third problem in the prior art, when a toudspeaker included in an acoustic system using the sourri 
image localization apparatus is small in diameter, the large energy of the low-frequency conponent causes sound dis- 
tortion. The feedfonward type apparatus has high-pass frequency characteristics which cut off the low-frequency com- 

5 ponent. and is suited to that system. Accordingly, the sound image localization apparatus of the fourth embodiment 
switches a feedback or feedforward type apparatus by the switches, so that when a loudspeaker with a large diameter 
is used, the apparatus operates as a feedljack drcurt so that good sound quality can be reproduced, while when a loud- 
speaker with a small diameter is used, the apparatus operates as a feedfonward circuit so as to prevent sound distortion. 
Thus, the sound inrrage localization apparatus of the fourth enrtxxliment includes the switches 1218a and 1218b. 

10 thereby becoming suited to an acoustic system, to which the apparatus Is applied, by switching feedback and feedfor- 
ward. 

Rg. 13 is a diagram showing a structure of a second exanrtple of the sound image localization apparatus of the 
fourth emtxxliment. Fig. 14 is a diagram showing a structure of a third example of the sourKi image localization appa- 
ratus of the fourth emlxxJiment. As shown in Fig. 13, the second example of the apparatus is the apparatus according 

15 to the first emlxxfiment that crosstalk cancellation is performed on the input side, and further that switches are added. 
The third example of the apparatus shown In Fig. 14 comprises the feedback type apparatus In Fig. 18 and, further, 
switches, as the first example does. While in the first example the switches are disposed at the rear of the crosstalk can- 
celing signal generating filter, I.e., on the output side, In the third example the swvitches are disposed In front of the filter, 
i.e., on the Input side. The second and third examples of the sound image localization apparatus shown in Figs. 13 and 

20 14 can be suited to an acoustic system by switching feedback and feedfonward. 

[Embodiment 5] 

A sound image localization apparatus in accordance with a fifth embodiment has capability of changing an initial 
25 d^ay In generating a crosstalk canceling signal. 

Fig. 15 Is a diagram showing a structure of the sound Image localization of the fifth embodiment. As shown In the 
figure, the sound Image localization of the fifth embodiment is such that delaying units 151 la to 151 Id and switches 
1518a and 1518b are added to the feedback type apparatus shown in Fig. 18. 

In the situation shown in Rg. 1 5. the switches 1 51 8a and 1 51 8b are set in a way that the crosstalk canceling signal 
30 generating filters 1506a and 1506b output generated signals to the adders 1503b and 1503a without passing the sig- 
nals through the delay units. In this situation, the sound image localization of the fifth embodiment is equivalerrt to the 
apparatus shown In Rg. 18. The sound image localization apparatus of the fifth embodiment with this setting operates 
in a similar way to the second example In the prior art 

The sound Image localization apparatus can use delayed crosstalk cancding signals held In the delaying units 
35 1 51 1 b and 1 51 1 d, or delayed crosstalk canceling signals heW in the d^aying units 1 51 1 a and 1 51 1 c. depending on the 
setting of the switches 1518a and 1518b. respectively The sourxl image localization apparatus of the fifth embodiment 
with this setting operates In a similar way to that described in the first emfcKxJiment, except that the delayed crosstalk 
canceling signal is used for crosstalk cancellation. 

In calculation by the crosstalk canceling signal generating filter, the Input signal Is multiplied by the coefficient 
40 shown in the equation 7-3. representing the ratio of the head related transfer functions SC and SM shown in Fig. 1 9(b). 
As Is apparent from Fig. 1 9(b), as the crosstalk path is longer than the main path; there occurs a difference in the times 
of an^ivals of sourrcJ signals from two loudspeakers. When the angle of the two loudspeakers is small, the difference in 
the arrival time is small. When the angle is large, the difference in the arrival time is large. This must be taken into 
account for sound image localization. In the crosstalk canceling signal generating filter, tiie arrival time difference is 
45 equivalent to the amount of an initial delay Therefore, in an acoustic system using a sound image localization appara- 
tus, when the fixed annount of an initial delay is used, if the positions of setting up the loudspeakers are changed, cross- 
talk cancellaticn is not possibly satisfactory 

In the crosstalk canceling signal generating filter, in cases excqjt for initial delay, tiie frequency characteristics do 
not change to a large extent if the angle of two loudspeakers is arourxJ 30 to 60 degrees. The change In tiie angle can 
so be coped witii by switching initial delays. The sound Image localization apparatus of the fifth embodiment can change 
the amount of an initial delay in a step-by-step mann^ by setting of the switches. 

As described above, the sound image localization apparatus in accordance with the fifth embodiment furtiier 
Includes the delaying units 1 51 1 a to 1 51 1 d and tiie switches 1 51 8a and 1 51 8b. thereby performing a high level of sound 
image localization by coping with a case where the angle of two loudspeakers are changed in an acoustic system to 
55 which the apparatus is applied. 
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[Embodiment 6] 

A sound image localization apparatus in acxxjrdance with a sixth embodiment changes a crosstalk canceling signal 
generating filter 

5 Fig. 1 6 is a block diagram shewing a structure of the sound image localization apparatus of the sixth emtxxJiment. 
As shown in the figure, the sound image localization apparatus comprises main-path filters 1 607a and 1 607b, crosstalk- 
path fiKers 1608a and 1608b. adders 1603a to 1603f. crosstalk canceling signal generating filters 1606a and 1606b. 
delaying units 1611a to 161 Id. multipliers 1610x1 to 1610x4. inverting circuits 1631a and 1631b. and switches 1618a 
to 1618f. The apparatus receives input sound signals through input terminals 1604a to 1604d. and outputs processed 

10 signals through output terminals 1 605a and 1605b. 

Thedelaying units 161 la and 1611b. the multipliers 1610x1 and 1610x2. and the adder 1603c constitute a first FIR 
filter having two taps. The delaying units 1611c and 161 id, the multpliers 1610x3 and 1610x4. and the add©- 1603d 
constitute a second FIR filter having two taps. Either fitter functions as a aosstalk canceling signal generating fitter. The 
switches 1618a to 161 8f are switched depending on the distance between two loudspeakers of an acoustic system 

15 using the sound image localization apparatus. 

The main-path filters 1 607a and 1 607b, the crosstalk-path filters 1 608a and 1 608b. the adders 1 603a to 1 603d. and 
the crosstalk canceling signal generating filters 1 606a and 1 606b are similar to those of the feedback type sound image 
localization apparatus shown in Figs. 1(a) and 1(b). 

The operation of the sound image k>calization apparatus of the sixth embodiment will be described as to when the 

20 distance between two loudspeakers is wide or narrow. 

At first, when the distance between two loudspeakers is wide, the switches 1618a. 1618b. 1618e, and 1618f are 
set to respective W sides, while the switches 1 61 8c and 1 61 8d are set to be released. This is the situation shown in the 
figure. In this case, sound signals input through the input terminals 1 604c and 1604d are output to the output terminals 
1605a artd 1606b. passing through the sound image localization apparatus of the sixth embodiment. 

25 Signals input through the input terminals 1 604a and 1 604b are subjected to directional localization, and then, input 
through the switches 1618a and 1618b to the crosstalk canceling signal generating filters 1606a and 1606b. Thereafter, 
signals output from the first and second FIR filters each having two taps are not used because the swrtches 1 61 8c and 
1618d are released. Therefore, the operation of the apparatus is equivalent to that of the feedback type sound image 
localization apparatus shown in Fig. 1 8. 

30 As opposed to this, when the distance between the two loudspeakers is narrow, the switches 1 61 8a. 1 61 8b. 1 61 8e, 
and 1618f are set to N sides, while the switches 1618c and 1618d are closed. Thus, signals after subjected to direc- 
tional localization are processed by the first and second FIR filters each having two taps, and then, input through the 
switches 1 61 8c and 1 61 8d to the adders 1 603a and 1 603b. That is. the first and second FIR filters are used for crosstalk 
cancellation. 

35 On the other hand, the phases of sound signals input through the input terminals 1 604c and 1604d are inverted by 
the inverting circuits 1631a and 1631b, and then, input through the switches 161 8a and 1618b to the filters 1606a and 
1606b. The filters 1606a and 1606b generate signals based on the phase inverted signals, and output the generated 
signals to the adders 1603a and 1603b. 

In this case, the channels to the adders 1603a and 1603b function as main paths due to the switches 1618e and 

40 I618f. while the filters 1606a and 1606b generate crosstalk canceling signals. This is effective processing wrtien a 
sound image to be localized at the front position and a sound image to be localized at an arbitrary position (at the side 
or the rear) coexist in a sound signal. When the distance between two loudspeakers is nan^ow. if a sound image to be 
localized at the front is extended further outward, stereophony increases. 

That is. in the apparatus of the sixth emtxxliment. a sound signal of the sound image to be localized at the aibitrary 

45 position is input through the input terminals 1604a and 1604b. while a sound signal of the sound image to be localized 
at the front position is input through the input terminals 1604c and 16d4d. \A/hen the distance between two loudspeak- 
ers is wide, the sound image to be localized at the front position is output as it is. while the sound image to be localized 
at the arbitrary position is subjected to crosstalk cancellation similar to that in the first embodiment. When the distance 
between the two loudspeakers is narrow, a crosstalk canceling signal is generated for the sound image to be localized 

so at the front position to extend the sound image outward. On the other hand, for the sound image to be localized at the 
artMtrary position, the crosstalk canceling signal generating filter used for sound localization multiplies an input signal 
by the coefficient shown in the equation 7-3, representing the ratio of the head related transfer functions SC and SM 
shown in Fig. 19(b). Because the distance between the two loudspeakers is narrow, the ratio is small, so that it is pos- 
sible to use a filter having a small number of taps. TTierefore. the filter having two taps is used. 

55 As described above, the sound image localization apparatus of the axth embodiment conprises the conventional 
feedback type sound image localization apparatus and. further, the FIR filters with two taps comprising the delaying 
units 161 la to 161 Id. the multipliers 1610x1 to 1610x4. and the adders 1603c to 1603d. the switches 1618a to 1618d. 
and the inverting circuits 1631a and 1631b, whereby when the distance between two loudspeakers is wide, the feed- 
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back sound lcx;alization similar to that in the first embodiment is performed, while when the dstance between two loud- 
speakers is nanrow. the outuvard extension of a sound image to be localized at the front is performed as well as the 
feedback sound localization. 

Note that although the apparatus of the sixth emtxxiiment is based on the feedback type sound image localization 
apparatus shown In Rg. 18. the apparatus of the sixth emtxxJiment can be based on the feedfonward type apparatus 
shown in Fig. 17(b) or the apparatus of the first emtxxiiment shown in Fig, 1(b). 

Claims 

1. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal, and performing crosstalk cancellation 
using the crosstalk carK;eling signal; and 

direction localizing means for localizing the direction of a virtual sound source position by processing the signal 
subjected to crosstalk cancellation in said crosstalk canceling means. 

2. The sound image localization apparatus of daim 1 wherein 

said crosstalk canceling means comprise first and second crosstalk canceling signal generating filters, and first 
and second adders, said first adder adding a first sound signal and a signal generated by said second crosstalk 
canceling signal generating fitter, and said second adder adding a second sound signal and a signal generated 
by said first crosstalk canceling signal generating fitter; 

said direction localizing means comprise first and second main-path filters, first and second crosstalk-path fi- 
ters. and first arKi second adders, said first ackier adding a signal processed by sa\6 first main-path filter and a 
signal processed by said second aosstalk-path filter, and said second adder adding a signal processed by said 
second main-path filter and a signal processed by said first crosstalk-path filter. 

3. A sound Image localization apparatus receiving a sound signal, perfonning signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound inr\age localization signal, sakJ apparatus comprising: 

crosstalk canceling means for including a comb fitter to generate the crosstalk canceling signal, and performing 

crosstalk cancelation using the crosstalk canceling signal; and 

direction localizing means for localizing the direction of a virtual sound source position. 

4. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal generated at a certain time, holding the 
crosstalk canceling signal, delaying the crosstalk canceling signal held, hokling the plurality of crosstalk can- 
celing signals delayed, and multiplying some of the plurality of crosstalk canceling signals held, by a predeter- 
mined coefficient to generate the crosstalk canceling signal at a time following the certain time; and 
direction localizing means for localizing the direction of a virtual sound source positron. 

5. The sound image localization apparatus of any of daim 3 and claim 4 wherein 

said apparatus further conprlses a low-pass filter processing a signal Input to or output from said crosstalk 
canceling means. 

6. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, saki apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk can- 
celing signal, and a switch switehing the crosstalk canceling signal generated by said aosstalk canceling sig- 
nal generating filter to the output side f said crosstalk canceling signal generating filter or to the Input side of 
said crosstalk canceling signal generating filter; and 

direction localizing means for localizing thedirectfon of a virtual sound source position. 
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7. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputling a sound image localization signal, said apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk can- 
5 celing signal, and a delaying unit delaying a signal input to or output from said crosstalk canceling signal gen- 

erating filter by various times; and 

direction localizing means for localizing the direction of a virtual sound source position. 

a. A sound image localization apparatus receiving an input sound signal to be localized in a first direction, and an 
10 input sound signal to be localized in a second direction, performing signal processing to the input sound signals, 
localizing virtual sound images, and outputting sound image localization signals, said apparatus comprising: 

crosstalk canceling means comprising a first filter, a second filter, and a switch switching first and second 
modes: in the first mode said first filter functioning as a filter generating the crosstalk canceling signal, and in 
15 the second mode said second filter functioning as a filter generating the crosstalk canceling signal while said 

first fitter functioning as a filter localizing the second direction; and 
direction localizing means for localizing the direction of a virtual sound source position. 
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(54) Apparatus for localization of sound image 

(57) A sound image localization apparatus com- 
prises crosstalk canceling means and direction localiz- 
ing means, wherein first the crosstalk canceling means 
first subject an input sound signal to crosstalk cancella- 
tion, and then, the direction localizing means subject the 
processed signal to directional localization, whereby 
both crosstalk cancellation and directional localization 
share a signal to be processed, so the necessary 
arrK>unt of a storage device to hokJ the signal is 
reduced. That is. a reduction in circuit scale and calcu- 
lation load can provide a sound image localization 
apparatus with low cost and high processing precision. 
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Description 

FIELD OF THE INVENmON 

5 TTie present invention relates to an apparatus for localization of a sound image and. more particularly, to an appa- 

ratus for localization of a sound image which receives a sound signal, subjects the sound signal to signal processing, 
localizes a virtual sound image, and outputs a sound image localization signal. 

BACKGROUND OF THE INVENTION 

10 

A conventional stereophonic system controls sound Image localization using a plural of (generally two) loudspeak- 
ers, conferring a realistic sensation to the hearing of a fistener. The conventional system usually indudes two laterally 
spaced loudspeakers in front of the listener, so a sound image is localized between them. Outside the two loudspeakers 
no sound image is k>calized in the system. To obtain the effect that a sound image is localized outside the two loud- 

15 speakers, i.e.. the sun-ound of the listener, for instance, a sound from the t>ack of the listener, the syst«n sometimes 
includes loudspeakers at the rear as wen as the two loudspeakers in front of the listener. 

The development of technology for digitizing audio and hardware for DSP (Digital Signal Processor) facilitates var- 
ious signal processing. Owing to this, the system using two loudspeakers in front of the listener can localize a sound 
innage at any position arourvJ the listener, such as the side arxJ rear of the listener. 

20 The prior art sound image locaRzation apparatus has been discussed in "A Study of Cancellation of Crosstalk Sig- 
nal for Sound FiekJ Contror', Collective Papers of Spring Convention of Japanese Acoustical Society. 1996. pp 549-550 
(hereinafter referred to as bibliography 1). 

Figs. 1 9(a) and 1 9(b) are diagrams for explaining about sound image localization. Fig. 1 9(a) shows a sound image 
to be localized in a virtual way. Fig. 19(b) shows a system using two loudspeakers. In this case, it is assumed that the 

25 positions of virtually localized sound images, and the positions of the two loudspeakers are left-and-right symmetrical 
with respect to the listener 

In the sound image localization apparatus, a direction of a virtual position is localized and crosstalk is canceled by 
signal processing using a head related transfer function indicating transfer characteristics of sound from a sound source 
to the listener's head or ear. 

30 Here, in case like Rg. 19(b). a crosstalk signal is a signal transferred from a left toudspeaker to a right ear. or from 
a right loudspeaker to a left ear. A signal is generated for canceling the crosstalk signal- 
In the virtual environment achieved by this system as shown in Fig. 19(a), sound signals uL and uR are radiated 
from the positions of virtual sound images k)cated laterally at the back of the listener. Reference numerals. yLI and 
yRI . indicate sound pressures given to left and right ears, respectively. Because of the left-and-right symmetry, transfer 

35 of sound from the left virtual position to the left ear is the same as that from the right virtual position to the right ear. 
Ahead related transfer function showing this transfer characteristics is indicated by TM. The transfer of sound from the 
left virtual position to the right ear and that from the right virtual position to the left ear are represented by the same head 
related transfer function TC. The relation between the sound pressures and the functions are represented by 

40 yL1 =TM-uL + TC«uR (1-1) 

and 

yRI = TC • uL + TM • uR (1-2)- 

45 

On the other hand, in a system shown in Fig. 19(b). left and right loudspeakers 1901a and 1901b radiate sound 
signals xL and xR, respectively. Sound pressures given to the left and right ears of the listener are yL2 and y R2. respec- 
tively. As they are left-and-right symmetrical, the transfer of sound from the left loudspeaker position to the left ear and 
that from the right loudspeaker position to the right ear are represented by the same head related transfer function Sf^. 
50 The transfer of sound from the left toudspeaker position to the right ear and that from the right toudspeaker position to 
the left ear are also r^esented by the same head related transfer function SC. The relation between those sound pres- 
sures and those functions are 

yL2 = SM • xL + SC • xR (2-1) 

55 

and 

yR2 = SC • xL + SM * xR (2-2). 
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In this system, to localize the positions of the sound images shown in Fig. 19(a) using acoustics output from the 
loudspeakers 1901a and 1901b. the following equations must be satisfied. 



5 

and 



yLl=yL2 (3.1) 



yRl = yR2 (3.2). 

10 The equations 3-1. 1-1. and 2-1 lead to the following equation 4-1. and the equations 3-2. 1-2 and 2-2 lead to the fol- 
lowing equation 4-2, 

TM • uL + TC • uR = SM • xL + SC • xR (4.I) 

15 and 

TC • uL + TM • uR = SC • xL + SM • xR (4-2). 
by ri^^ *^ *^ ^^'^^ fro"^ the equations 4-1 and 4-2. If assumed that, the gain being represented 



|(SC/SM)^|«1 (5) 



xL and xR are approximated by 

25 



30 



xL ^ (FM + FC • FX) • uL + (FC + FM • FX) • uR (6-1) 

and 

xR ^ (FC + FM • FX) • uL + (FM + FC • FX) • uR (6-2). 

where 



FM = TM/SM 

35 

FC = TC/SM 

and 

FX = SC/SM 

The other solution is possible, that is. 

xL = FM • uL + FC • uR + FX • xR 



45 



and 

xR « FC • uL + FM • uR + FX • xL 



(7-1). 
(7-2). 

(7-3). 

(8-1) 

(8-2) 



11^?^.' 1^ ^^^^^^ and 8-2. the first and second terms on the right side indicate the directions of sound 
«mages. that is. they localize the directions. The third term on the right side cancels a crosstalk component 

Using the above relations, a conventional sound image localization apparatus is constructed, shown in Fig 1 7(a) 
ml^T^f "!L^ apparatus comprises a crosstalk canceling means 1 701. direction localizing 

« i 1 7^ ^; ^"^^"^ ^^^^^ ^""^ *"P^ *h^0"9^^ *"P^ terminals 1704a and 

nils l 7o£"^^ subjecting the input sound signals to signal processing are output through output termi- 

i7n^!^'^nTK'f^^''^'"^ ^^^^^ ^^^^^ ^^""^ ^^S"^*^ '"P"* ^^o^^^ the input terminals 

1704a and 1704b to generate signals indicating the directions of sound image positions, respectively. The adders 
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1703a and 1703b add input signals. The crosstalk canceling means 1701 removes a crosstalk component of an input 

^'^"fki 170» is a diagram illustrating an example of detailed structure of the conventional sound image localization 

appISU Se cfoSllk^nceRng means 1701 shown in Rg. 17(a) comprises -^^^fi;^"^'^^^^^^^^^ 

ta^ 1706a and 1706b and adders 1703c and 1703d. The direction localizing means 1702a and 1702b shown in P.g. 

nZ co^ri^e mL^St^t^^lTo7a and 1707b. and crosstalk-path fOters 1708a and 1708b respectively. The com- 
hSnn TrnTrr^n-iS^ fitter and the crosstalk-path fitter is sometimes called a direction localizing fitter. 

re pliraT3^.^ge^Satron appaSus generates the outputs xL and xR according to the expressions 6- 
1 and 6-2 A description vnll be given of how the sound image locaBzation apparatus works. 

Left a,^ rS^S^ sound Agnate are input through the input terminals 1704a and 1704b. ^espect.velyJT,e fos^ 
i«ut Su^X SSrough L input ter^nal 1704a is input to the main-path fitter 1707a and the crc^stalk-path 
rfl^Sa ^ mSpath fitter 1707a multiplies the input signal by the coefficient shown the^uaton 7-1 _The 
cJ^Cti^^TO^ mutt-plies the input sign^ by the coeff«.ent sh,«vn in t-;- ^ °* 

main-pathfBter 1 707a and the crosstalk-path filter 1 708a are input to the adders 1 703a and 1 703b. ' espectiv^y. 

sS y the second input sound signal input through the input terminal 1 704b is input to 
and The woitalk-path fitter 1708b. where the input signal is muttiplied by the coeffiaents expressed by 7-1 and 7-2 
riJSvTl^Xu^ Sthe maln^^th fater 1^^^ 

""'re^ide'Jmaaand 1703b each add irput signals. The adder 1703a outputs a resutt of the acWtt^^^^^^ 

1 703c ar^tti crosstalk cancelUig signal generating filter 1 706a. The aosstalk canceling signal generating fitter 1 706a 

Xli^th?«^SIl^it"*e^Jid 

lSte*'a^i"l7!)U^^ a?^ of the addttion to the adder 1703d and the crosstalk canceling signal 
aene atg mri'SS^ ™crc^lk canceling signal generating filter 1706b multiplies the input signa by the 
^J^ Z?^^ bTt*^e equation 7-3 to produce a aosstalk canceling signal, and outputs the signal to the adder 

^^°^^e adders 1703c and 1703d each add resutts of addition by the adders 1703a and 1703b to the cro^alk <»nce- 

fthe adder 1703d on the side having the output terminal 1 705b). This structure is caUed feedforward. 

fe^an iparatus wNch is a second example realizing the conventional sound image localization ^para- 
tus PnSSSe StS PuwJh^Appncation No Hei 9-233599 (1997) (hereinafter referred to as btoliography 2). 

Fig 1^?s a d^g^ shS?^^^ structure of a second example of the sound '"-age lo^ -aton apparati«^ 
TT,» oLcTa^ cancelina means 1701 in Fig 17(a) comprises crosstalk canceling signal generating fitters 1806a and 
IS^^I^eriS^^^^^ The'direiion .o<Sizing means 1702a a^1702b in ^^^^l^^) ^^^^^ 

nSifittere 1807a and 1807b. and crosstalk-path filters 1808a and 1808b. respectwely. "me adders 1803a and l^^b 
^rihp tame as the^^ 1703a and 1703b in Fig. 17(a), and also part of the crosstalk canceling means 1 701 . 
'"^eLun^r^IgeS^^ 

a 1 and 8 2 With tine diHerent structure from that shown in Fig. 17(b). the sound image 'ocalization apparatus is cabled 
a feSicktJ^f b^t^rrcri^^^^ cancenng signal generating fitter (for instance. 1806a) °" ^^^^^^""f' ^"^'^ 
a i^t^lSirtnpl^S on the other channel (tiie adder 1803b). A description will be g^en of how the sound image 

'"^{^"^ZlntT^o^^^^r^^s are input through the input terminals 1804a and 1804b. re^ectivelyjhef^t 
input 2tJ?s^SSl irS,uro^hL input terminal 1804a is input to the main-path fitter 1807a ar^ 'l^^^tiSr T 

cmssJk canceliiw signal gencralinti lillef t806a. me crossB* canceling signal generating Mer SOea muB^iM me 
LC.iter6jt2?i^»S^J^!S;°ng Signal glLaUnglme, ,8^ 
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resented by the equation 7-3 to generate a crosstalk canceling signal, ard outputs it to the adder 1803a. 

The adders 1 803a and 1 803b add the outputs of the direction localizing filter, and further add a result of the addition 
to the crosstalk canceling signal having phase almost equivalent to the inversed phase of the result of the addition, to 
renrwve a crosstalk connponent. Hence» signals represented by the equations 8-1 and 8-2 are output through the output 
5 terminals 1805a and 1805b. 

As hereinbefore described, in the sound image localization apparatus in accordance with the first embodiment, 
multiple cancellation, in which the generation of a crosstalk canceling signal and the crosstalk cancellation using the 
generated signal are repeated, becomes possible. Compared with the first example, i.e., the feedfonvard type appara- 
tus shown in Rg. 17(a). the adverse effect of sound diffraction of a low-frequency componerrt of a sound signal is 
10 reduced, thereby solving the first problem of the prior art and improving low-frequency characteristics. 

As described above, the conventional sound image localization apparatus can localize a sound image over a wide 
range by localization of a virtual sound image and compensation of a crosstalk component. However, when trying to 
realize the foregoing sound image localization apparatus by a computer system using a CPU and a DSP. the following 
several problems arise. 

15 The first problem is about a memory used for temporary storage in operational processing. The amount and per- 
formance of a memory in a computer system limit operational processing. The main constraints on memory are 

(A) constraint on the amount of memory for storage of sound signal data, 

(B) constraint on the amount of memory for storage of coefficients of a filter, and 
20 (C) constraint on accessing time of a memory. 

As to (A) and (B). when the number of words showing the amount of memory is small, the number of taps indicating 
the order of a fitter is limited to an insufficient size, resulting in a reduction in precision of operational processing. 

Furthermore, when the anx>unt of a high-speed internal memory included in a computer system is limited, if a rel- 
25 atively low-speed external memory (RAM) assists to secure a required precision of operational processing, the problem 
(C) arises. Because frequent memory accesses occur in operational processing realizing the above-descril>ed digital 
filter performing directional localization and crosstalk carrcellation. a simple supplement of the external memory having 
a low accessing speed hardly solves the constraint on the amount of memory. 

The second problem relates to a controller included in a computer system, such as DSP. The processing speed of 
30 the controller limits operational processing. When the processing speed is not sufficient, the order of a digital filter is 
limited, thereby reducing precision in operational processing. 

The third problem is that it is difficult for the conv^tional sound image localization apparatus to deal with changes 
in setting of an acoustic system using it. The second example of the prior art sound image localization apparatus shown 
in Rg. 18. i.e.. the feedback type, improves the reproducibilrty of a low-frequency component corr^red with the feed- 
35 forward type. However, when a loudspeaker with a small diameter is used in an acoustic system to which the sourxl 
image localization apparatus is applied, the large energy of the low-frequency range causes sound distortion. If a filter 
cutting off a low-frequency component is adopted to improve this point, the additional fitter increases the circuit scale 
and the cost. 

Further, when loudspeakers are rearranged in the acoustic system in such a way as that the angle the loudspeak- 
40 ers attain changes, the conventional sound image localization apparatus nnodifies all the parameters of the filter FX. 
Thus, to adapt to changes in setting of tiie acoustic system, parameters for each setting are required to be held. The 
requirement of storage of parameters increases the amount of memory. 

As the three problems indicate, the prior art sound image localization apparatus has a difficulty in improving low- 
frequency characteristics. Furthermore, when inrtplemented in a computer system, the apparatus requires the large 
45 annount of memory arxJ the high-speed of processing, thereby making it difficult to realize both precision of controlling 
sourKi in>age localization and a reduction in costs of the computer system. 

SUMMARY OF THE INVENTION 

so It is an object of the present invention to provide a sound image localization apparatus realizing sound image local- 
ization with good precision while limiting an increase in the circuit scale caused by requirement of the amount of mem- 
ory. 

It is another object of tiie present invention to provide a sound image localization apparatus realizing sound image 
localization with good precision by additionally exploiting an external memory when the amount of a high-speed internal 
55 memory is limited. 

It is still another object of the present invention to provide a sound innage localization apparatus realizing sourxJ 
image focalization with good precision by simplifying operational processing when the computer system does not 
include a high-performance DSP 
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It is yet another object of the present invention to provide a sound image localization apparatus flexibly coping with 
changes in setting of the acoustic system, wrthout increasmg the circuit scale. 

Other objects and advantages of the present invention will become apparent from the detailed description desired 
hereinafter- it should be understood, however, that the detailed description and specific embodiment are desired by way 
of niustration only, since various changes and modifications within the scope of the invention winll become apparent to 
those skilled in the art from this detailed description. 

According to a second aspect of this invention, there is provided the sound image localization apparatus receiving 
a sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a 
sound image localization signal, the apparatus comprising: 

crosstalk cancefing means for generating a crosstalk canceling signal, and perfomiing crosstalk cancellation using 
the crosstalk canceling signal: and, • • i 

direction localizing means for localizing the direction of a virtual sound source position by processing the signal 
subjected to crosstalk cancellation in the crosstalk canceling means. 

As a result, the apparatus first performs crosstalk cancellation to an input sound signal, and thai, perfomis direc- 
tional localization to the sound signal. . r X- . ^«,«.«,^« 
According to a second aspect of this invention, there is provided the sound image kjcanzation apparatus of the first 

aspect wherein 

the crosstalk canceling means comprise first and second crosstalk canceling signal generating filters, and first and 
second adders, the first adder adding afirst sound signal and a signal generated by the second crosstalkcanceling 
signal generating filter, and the second adder adding a second sound signal and a signal generated by the frst 
crosstalk canceling signal generating filter; a. .n*.,- 

the direction localizing means comprise firet and second main-path fillers, first and second crosstalk-path fnters. 
and first and second adders, the first adder adding a signal processed by the first main-path f Bter and a signal proc- 
essed by the second crosstalk-path fflter, and the second adder adding a signal processed by the second main- 
path filter and a signal processed by the first crosstalk-path filter. 

As a resurt the apparatus first performs crosstalk cancellation to an input sound signal using a signal generated by 
a crosstalk canceling signal generating filter, and then, performs directional localization to the sound signal using a 
main-path filter and a crosstalk-path filter. = 

According to a thiid aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization sigruil. the apparatus comprising: 

crosstalk canceling means for including a comb filter to generate the crosstalk canceling signal, and performing 

crosstalk cancellation using the crosstalk canceling signal; and 

direaion localizing means for localizing the direction of a virtual sound source posHion. 

As a result, the apparatus performs crosstalk cancellation using a signal generated by a crosstalk canceling signal 
generating filter including a comb filter of which the coefficients are the same. 

According to a fourth aspect of this invention, there is provided a sound image tocalization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal generated at a certain time, holding the 
crosstalk canceling signal, delaying the crosstalk canceling signal held, holding the plurality of crosstalk canceling 
signals delayed, and multiplying some of the plurality of crosstalk canceling signals held by a predetermined coef- 
ficient to generate the crosstalk canceling signal at a time following the certain time; and 
direction localizing means for localizing the direction of a virtual sound source position. 

As a result, the apparatus performs crosstalk cancellation using a singal generated a crosstalk cancefing signal 
generating filter including a circuit replacing a comb fflter, of which the processing load is reduced. 

According to a fifth aspect of this invention, there is provided the sound image tocalization apparatus of any of the 
third and fourth aspects wherein 

the apparatus further comprises a low-pass filter, processing a signal input to or output from the crosstalk canceling 
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means. 



As a result, the apparatus performs crosstalk cancellation to a signal, of which a high-frequency component is 
removed, using a singa! generated a crosstalk canceling signal generating filter including a comb filter or a circuit 
replacing a comb filter 

According to a sixth aspect of this invention, \h&re is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
image localization signal, the apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk cance- 
ling signal, and a switch switching the crosstalk canceling signal generated by the aosstalk canceling signal gen- 
erating filter to the output side of the crosstalk canceling signal generating filter or to the input side of the crosstalk 
canceling signal generating filter; and 

direction localizing means for localizing the direction of a virtual sound source position. 
As a result, the apparatus switches feedback processing and feedfonward processing. 

According to a seventh aspect of this invention, there is provided a sound image localization apparatus receiving a 
sound signal, performing signal processing to the sound signal, localizing a virtual sound image, and outputting a sound 
innage localization signal, the apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating fitter generating a crosstalk cance- 
ling signal, and a delaying unit delaying a signal input to or output from the crosstalk canceling signal generating 
filter by various times; and 

direction localizing means for localizing the direction of a virtual sound source position. 

As a result, the apparatus performs crosstalk cancellation by changing the amount of an initial delay. 

According to an eighth aspect of this invention, there is provided a sound image localization apparatus receiving an 
input sound signal to be localized in a first direction, and an input sound signal to be localized in a second direction, 
performing signal processing to the input sound signals, localizing virtual sound images, and outputting sound image 
localization signals, the apparatus comprising: 

crosstalk canceling means comprising a first filter, a second firter, and a switch switching first and second modes; 
in the first mode the first filter functioning as a filter generating the crosstalk canceling signal, and in the second 
nrxxJe the second filter functioning as a filter generating the crosstalk canceling signal while the first filter functioning 
as a filter localizing the second direction; and 

direction localizing means for localizing the direction of a virtual sound source position. 

As a result, a crosstalk canceling signal generating filter for localizing a sound image to be localized in a first direc- 
tion, and a crosstalk canceling signal generating f Hter for localizing a sound image to be localized in a second direction 
are switched. 

BRIEF DESCRIPTION OF THE DRAWINGS 

Figs. 1 (a) and 1(b) are block diagrams showing structures of a sound image localization apparatus in accordance 
with a first embodiment of this invention. 

Rg. 2 is a diagram showing an example of a structure of a filter included in the sound image localization apparatus 
of the first emlxxJiment. 

Fig. 3 is a diagram showing an example of a structure of a filter included in the sound image tocalization apparatus 
of the first embodiment. 

Fig. 4 is a block diagram showing a structure of an application example of the sound image localization apparatus 
of the first embodiment. 

Fig. 5 is a block diagram showing a structure of a sound image localization apparatus in accordance with a second 
embodiment of this invaition. 

Fig. 6 is a block diagram showving a structure of an application exanple of the sound image localization apparatus 
of the second embodiment. 

Rgs. 7(a) and 7(b) are graphs showing frequency characteristics of a filter used in the second embodiment to 
explain how the filter works. 

Fig. 8 is a block diagram showing a structure of an application example of the sound image localization apparatus 
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of the second ennix)dimerrt. . 

Rg. 9 is a block diagram showing a structure of an application example of the sound image local^aton apparatus 

Sg^'to Uo^glarshowing a stnicture of an application example of the sound image localization apparatus 

Rg^'l'STS.SS^m Showing a structure of a sound image loc^i.a«on apparatus in accordance with a tl^rd 

F^^ 'irTt-^irJir^^^^^^ a structure of a sound image Realization apparatus in accordance with a fourth 

rHs'I?! Wo*dia^S^^^^ a stnicture of an application example of the sound Image localization apparatus 

rT^^T^^'S^s^a^g a structure of an application example of the sound image localization apparatus 

ng*" 1 sTsTJ^a^m showing a structure of a sound image localization apparatus in accordance wfth a fifth 

embodiment of this invention. ^^w=«,.a a ciYth 

Rg. 16 is a block diagram showing a structure of a sound image localization apparatus m accordance wrth a sixth 

^nSl^ "^m^To^ diagrams showing structures of a first exanple of a prior art sound image localiza- 

F?g. ^ w'ock diagram showing a structure of a second example of a prior art sound image localization appara- 
tus. 

Rgs. 19(a) and 19(b) are diagrams for explaining sound image kxaiizaton. 
nPTAILED DFRnRIPTIQN OF THE PREFF PPF" FMRODIMENTS 
[Embodiment 1] 

A sound image localization apparatus in accordance with a first embodiment of this invention reduces the nec^- 
sary a^um TrSL^ by subjeSng a signal to directional localization after performing crosstalk cancellation to the 

^^%a 1(a) is a block diagram showing a structure of the sound image tocalization apparatus of the ^^o^'Jf^ 
As sSvn n ike f-«ure. the sound image localization apparatus comprises a crosstalk canceling means ^^^^ ^'f. 
tton kSIiSrmeans 1 02a and 1 02b. adders 1 03a and 1 03b. The apparatus receives input sound signals through input 
i^nS lX^ 10^ si^iects the input signals to signal processing, and outputs the resulting signals through out- 

cri^t^^ca^^^nTmeans 101 remove aosstalK components from the input signals H^j;;^,*'™'^^^*^^^^^ 
terminals 104a and 104b. The direction localizing means 102a and 102b process input sound signals to produce sig 
nals indicating the directions of sound images. The adders 103a and 103b add input signals. 

-STe^pSSnal processing of the sound image k)calization apparatus will be explained. Imtally. m add*on to me 
equa^ons 1 1 to Si sh^n inL BACKGROUND OF THE INVENTION and Embodiment 1 sections. vL and vR are 
defined by 

xL=FM-vL+FC-vR ^^'^^ 



(9-2). 



and 

xR = FC*vL+FM*vR 

The equation 9-1 is substituted to the equation 8-1 . and 9-2 is substituted to 8-2. and then 

FM-vL+FC-vR = FM-uL+FC-uR+FX-(FC-vL+FM-vR) 00-1) 



and 

FC • vL + FM • vR = FC • uL + FM • uR + FX • (FM • vL + FC • vR) 
are obtained. From 10-1 and 10-2. FM and FC are ^iminated, and then 



(10-2) 
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vL=ruL + FX-vR (11-1) I 

and 

5 vR = uR + FX-vL (11-2) 

are obtained. 

The equations 1 1 -1 and 1 1 -2 mean that a crosstalk canceling means is required to be set up on the input side. The 
equations 9-1 and 9-2 mean that direction localizing means are required to be set up on the output skie. Accordingly, 
10 the sound image localization apparatus of the first embodiment, as shown in Fig. 1(a), includes a crosstalk canceling 
means 101 on the input side, and direction localizing means 102a and 102b on the output side. 

Fig. 1(b) is a diagram showing a detailed structure of a first example of the sound image localization apparatus of 
the first embodiment. The crosstalk canceling means 101 shown in Fig. 1 (a) comprises crosstalk canceling signal gen- 
erating filters 106a and 106b. and adders 103c and 103d in Fig. 1(b). The direction localizing means 102a and 102b 
15 shown in Fig. 1(b) comprise main-path filters 107a and 107b, and crosstalk-path filters 108a and 108b in Fig. 1(b), 
respectively. An explanation will be given of the operation of the first example of the sound inr^ge localization apparatus. 

Left and right input sound signals uL and uR are input through input terminals 104a and 104b. In Fig. 1(b). the first 
input sound signal uL input through the Input terminal 104a is input to the adder 103c. The rigtit input sound signal uR 
input through the input terminal 104b is input to the adder 103d. Immediately after the sound image localization appa- 
20 ratus starts processing, the crosstalk canceling signal generating filters 1 06a and 1 06b doni generate any signals to be 
output to the adders 103c and 103d. so the adders 103c and 103d output input signals uL and uR as they are. The sig- 
nals uL arxJ uR are input to the crosstalk canceling signal generating filters I06a and 106b as signals vL and vR. 
respectively 

The crosstalk canceling signal generating filter 106a multiplies the input signal by the coeffident having a negative 
25 sign represented by the equation 7-3 to produce a crosstalk canceling signal, and outputs it to the adder 103d. The 
crosstalk canceling signal generating filter 1 06b performs a simitar processing to produce a crosstalk canceling signal, 
and outputs it to the adder 103c. 

The adder I03c adds the input sound signal uL and the crosstalk canceling signal to perform crosstalk cancellation, 
generating the signal vL represented by the equation 11-1. The generated signal vL is input to the main-path filter 1 07a 
30 and the crosstalk-path fitter 108a. In a similar manner, the adder 103d generates the signal vR represented by 11-2. 
which is input to the main-path filter 107b and the crosstalk-path filter 108b. 

The main-path fitter 107a multiplies the input signal by the coefficient represented by the equation 7-1 . arxJ outputs 
the result to the adder 103a. The crosstalk-path filter 108a multiplies the input signal by the coefficient represented by 
the equation 7-2, and outputs the resuH to the adder 1 03b. The output of the main-path filter 1 07a is represented by the 
35 first term on the right side of the equation 9-1 . The output of the crosstalk-path fitter 108a is represented by the second 
term on the right side of the equation 9-2. 

Simitarty the adder 103d adds the crosstalk canceling signal to the input sound signal uR to perform crosstalk can- 
cellation. The resulting signal vR is input to the main-path filter 107b and the crosstalk-path filter 108b. where the signal 
is multiplied by the coefficients represented by the equations 7-1 arxi 7-2, respectively The outputs of the main-path 
40 filter 1 07b and the crosstalk-path fitter 1 08b are input to the adders 1 03b and 1 03a, respectivety The output of the main- 
path filter I07b is represented by the first term on the right side of the equation 9-2. The output of the crosstalk-path 
filter I08a is represented by the second term on the right side of the equation 9-1. 

The adders 103a and 103b each add input signals, and output results of the addition through the output terminals 
105a arrd 105b. respectively. Thus, the sound image localization apparatus in accordarKe with the first emtxxliment 
45 outputs signals xL and xR processed by directior>al localization, represented by the equations 9-1 and 9-2. 

As described atx>ve. In the sound image localization apparatus in accordance with the first emtxxliment. because 
signals are subjected to crosstalk cancellation prior to directk>nal localization, as shown in Fig. 1(b). the inputs of the 
crosstalk canceling signal generating filter (FX) and the direction localizing filter (FM and FC) are the same signal. vL 
or vR. Thus, for filtering, just those two signals are required to hold. Compared with the conventional sound image local- 
50 ization apparatus shown in Rgs. 17(b) and 18. required to hold four kinds of signals, the amount of memory required to 
hold sound signals, described as the first problem in the BACKGROUND OF THE INVENTION section, can be reduced 
to a small size. 

To explain the required amount of memory in the apparatus of the first embodiment, each structure of filters for 
crosstalk cancellation and directional localization will be shown. 
55 There are two sorts of filters. FIR (Finite Inpulse Response) accumulating input signals and IIR (Infinite Impulse 
Response) accumulating output signals as welt as input signals. Either of the two kinds of filters can realize the sound 
image localization apparatus of the first embodiment- Rg. 2 is a diagram showing the first example of the apparatus in 
which the crosstalk canceling signal generating filters 106a and 106b, and the direction localizing fPters 107a. 107b, 
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1 08a. and 1 08b are FIR filters. Rg. 2 shows another example in which each fat r shown in Fig. 1 (b) is the concatenation 
of an FIR filter and an IIR fater. 

In Fig 2 the crosstalk canceOng signal generating filter 106a included in the first example (Fig. 1 (b)) of the sound 
image localization apparatus, comprises delaying units 1 1 la and 1 1 1c to 1 11f. multiprier 1 10x1 to 1 10x5. and an adder 
103i The crosstalk canceling signal generating filter 106b comprises delaying units 1 1 lb and 1 1 lg to 1 1 1j. multipliers 
1 10x6 to 1 10x10. and an adder 103]. The parts in Fig. 2 represented by the dashed lines, such as the multipliers 1 10x1 
to 1 10x5 and the delaying units 1 1 1c to 1 1 1f. show that the number of multipliers or delaying units is variable. 

The main-path filter 107a comprises delaying units 1 1 1c to 1 1 if. multipliers 1 10ml to 1 lOmS. and an adder 1 03e. 
The main-path fater 1 07b comprises delaying units 1 1 1g to 1 1 ij. muhipiiere 1 10m6 to 1 lOmlO, and an adder 103f. The 
crosstalk-path fater 108a comprises delaying units 1 1 1c to 1 1 1f and 1 1 1 n to 1 1 1p. multipliers 1 lOcI to 1 10c5, and an 
adder 103g. The crosstalk-path filter 108b comprises delaying units 1 1 1g to 1 1 1j and 1 1 1k to 1 1 1m. multipliers 1 1 0c6 
tollOclO. andanadder103h. . . , p. i 

Multipliers 1 lOal and 1 10a2 function as attenuators to prevent overflow in executing fixed point calculation. Delay- 
ing units 1 1 1 k to 1 1 1 p are employed to produce the time difference Ijetween both ears. 

As the filters in Fig. 2 include the delaying units 1 1 1c to 1 1 1j. the crosstalk canceling signal generating filer and the 
direction localizing filter receive the same irput signals, as signals vL or vR shown in Fig. 1(b). Hence, compared with 
the case where the input of each fater is held, it is possible to reduce the amount of memory required to hoW signals. 

Fig 2 shows the example using IIR filteis. In this example, a crosstalk canceling signal generating fater comprises 
IIR filter FXIs 1 12a and 1 12b. A main-path filter comprises IIR filter FMIs 1 13a and 1 13b. A crosstalk-path filter com- 
prises IIR fater FCIs 1 14a and 1 14b Those IIR filters are concatenated with the FIR fBters shown in Fig. 2. 

The portions of the main-path filter, the crosstalk-path fitter, and the crosstalk canceling signal generating filter, con- 
stituted by FIR fitters, are represented by FMF. FCF. and FXF. respectively. The FM. FC. and FX shown in the equatons 
7-1 to 7-3 are represented by 

FM = FMF-FMI (12-1), 
FC = FCF.FC1 02-2). 



and 

FX = FXF-FXI C2-3). 

Also in this case, similar to the structure shown in Fig. 2. the FIR filter portions share an input, thereby making it 
possible to reduce the required amount of memory. It should be noted that the reduction is not as much as that in the 
case where only the FIR f ilters are employed. . 

Fig 4 is a diagram illustrating a second example of a detailed structure of a sound image localization apparatus, 
shown in Fig 1(a). in accordance with the first embodiment. As shown in the figure, the second example of the sound 
image localization apparatus comprises adders 103a to 103d. crosstalk canceling signal generating filters 106a and 
106b main-path filters 107a and 107b. crosstalk-path filters 108a and 108b. Ngh-frequency main-path filters 1 17a and 
1 17b' subsampling circuits 1 15a and 1 15b. and band compositing circuits 1 16a and 1 16b. As in the first example shown 
in Fi^. 1(b). input sound signals are input through the input terminals 104a and 104b, and subjected to signal process- 
ing and the resulting signals are output through the output terminate 1 05a and 105b. 

' The subsampling circuits 1 15a and 1 15b subject input signals to prescribed subsampling to produce a low-fre- 
quency component and a high-frequency component. The band compositing circuits 1 16a and 1 16b subject irput sig- 
nals to prescribed composition to produce composite signals. The high-frequency main-path filters 117a and 1171) 
operate in a similar way to the main-path fiHers 107a and 1 07b. The adders 103a to 103d, the crosstalk canceling signal 
generating fitters 106a and 1 06b, main-path fitters 107a and 107b, and the crosstalk-path fiKers 108a and lOBbare sim- 
ilar to those in the first example. , . w _ n k-. 

The operation of the second exan^le of the sound image localization apparatus of the first embodiment will be 

d Gscri bod 

Left and right input sound signals are input through the input terminals 104a and 104b. The first input sound signal 
input through the input terminal 104a is input to the subsampling circuit 1 15a. The subsampling circuit 1 15a subsarn- 
ples the first input sound signal to a high-frequency component and a low-frequency component, and ou^P^^e ™f ' 
frequency component to the high-frequency main-path f nter 1 1 7a. and the low-frequency component to the adder 1 03c. 
The subsampling circuit 11 5b operates in a similar way. _ ^ ^ 

The high-frequency main-path fBters 117a and 117b multiply the input high-frequency components by the co^- 
cient represented by the equation 7-1 . and output the resulting signals to the band compositing circuits 1 16a and 1 16b. 
respectively. 
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The low-frequency component of the input sound signal is subjected to crosslalk cancellation and directional local- 
ization in a similar manner to the first example, and the resulting signals are input to the band compositing circuits 1 15a 
and 115b, respectively. The band compositing circuits 1 15a and 1 1 5b composite a signal resulting from processing the 
high-frequency component with the high-frequency filter, and a signal resulting from processing the low-frequency com- 

5 ponent by directional localization after crosstalk cancellation, and output the composite signals through the output ter- 
minals 105a and 105b. respectively. 

As is clear from the above, a second example of the sourKJ image localization apparatus subjects only the low-fre- 
quency component of the input signal to crosstalk cancellation. In general, the high-frequency component of an input 
signal is seriously affected by a slight shift of the head of a listener arxl differences among individuals, so that the benefit 

10 of crosstalk cancellation is little for the Ngh-frequency conrponent. Therefore, a second example of the sound image 
localization apparatus processes frie high-frequency component only with the main-path filter. Thus, because the target 
of crosstalk cancellation is only the low-frequency component, the number of sampling frequency can be reduced, 
thereby making it possil^le to make the sizes of filter circuits in Figs. 3 and 4 smaller without reducing the precision of 
sound image localization. 

IS As hereinl^efore pointed out. the sound image localization apparatus in accordance with the first embodiment, as 
shown in Fig. 1(a). comprises a crosstalk canceling means 101 on the input side, and direction localizing means 102a 
and 102b on the output side. Thereby, each filter included in the crosstalk canceling means 101 and the direction local- 
izing means 102a and 102b shares an input signal by using delaying units as shown in Figs. 2 and 3. As a result the 
anrxHjnt of memory required to hokJ a sound signal is reduced while sound image localization can be satisfactory 

20 

[Embodiment 2] 

A sound image localization apparatus in accordance with a second embodiment of this invention employs a comb 
filter. 

25 Fig. 5 is a block diagram showing a structure of a first example of the sound image localization apparatts of the 
second emtxxliment- The outline of the structure of the sound image localization apparatus is similar to the structure of 
the feedback type apparatus in the prior art shown in Fig. 18. As shown in Fig. 5, the sound image localization appara- 
tus coiTprises adders 503a. 503b. 503e, and 503f, main-path fitters 507a and 507b, crosstalk-path filters 508a and 
508b. delaying units 51 la to 51 1j. and multipliers 510x1 to 510x10. Input sound signals are input through input termi- 

30 nals 504a and 504b, and subjected to signal processing, and the resulting signals are output through output terminals 
505a and 505b. As in Fig. 2 and so on. dashed lines on rows of the delaying units and the multipliers represent an arbi- 
trary number of the delaying units and the multipliers in Rg. 5. 

In Fig. 5. the crosstalk canceling signal generating filter 106a shown in Fig. 18 comprises the delaying units 51 la. 
51 1c to 51 If, the multipliers 510x1 to 510x5. and the adder 503e. The crosstalk canceling signal generating filter 106b 

35 shown In Fig. 1 8 comprises the delaying units 51 lb. 51 1g to 51 1 j. the multipliers 510x6 to 510x10. and the adder 503f. 
All the coefficients of the multipliers 510x1 to 510x10 are possible to be the same, which makes the fflter a comb type. 
Therefore, when using a comb filter, it is possible to reduce the amount of memory, required to hokJ the coefficient, 
desalbed in the BACKGROUND IN THE INVENTION section, as the first problem (B). 

The operation of the sound image localization apparatus of the second emlxxliment is similar to that of the feed- 

40 back type sound image localization apparatus of the first emtxxlim^t. 

Figs. 7(a) and 7(b) are graphs for explaining frequency characteristics of a filter Fig. 7(a) shows amplitude charac- 
teristics. Fig. 7(b) indicates phase characteristics. In either figure, a sdkJ line represents characteristics of the comb fil- 
ter used in the second enrixxfiment. arKJ a dashed line represents characteristics obtained from the ratio of head related 
transfer functions. In general, a comb filter has linear phase type low-pass characteristics. As is apparent from the fig- 

45 ure. both the characteristics are similar to each other in a low-frequency range of the anrplitude and phase characteris- 
tics. As described in the first embodiment, cancellation is particularly effective in a low-frequency range of a sound 
signal. Because the characteristics of the comb filter is approximate to that obtained from the head related transfer func- 
tion in the low-frequency range, the comb filter operates well for the low-frequency range. For a high-frequency range 
in which the two characteristics differ, crosstalk cancellation is hardly effective, so the influence of differences between 

50 the two characteristics is little. 

Fig. 6 is a block diagram showing a structure of a second example of the sound image localization apparatus of the 
second embodiment As shown in Fig. 6. this example includes a first example of the sound image localization appara- 
tus, and further comprises low-pass filters 620a and 620b. The low-pass filter 620a comprises an adder 603c. multipli- 
ers 610f1 and 610f2, and a delaying unit 61 la. The low-pass filter 620b comprises an adder 603d. multipliers 610f3 and 

55 6l0f4, and a delaying unit 61 lb. 

As to the operation of the sound image tocalization apparatus, the high-frequency components of signals input to 
the crosstalk canceling signal generating filters 106a and 106b shown in Fig. 18 are removed, and the other operation 
is similar to that of the first example. As hereinbefore pointed out. in generating a crosstalk canceling signal, the high- 
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frequency conponent of a sound signal is not necessarily taken into consideration. In this example, the high-frequency 
coirponent is not the target of processing, thereby making it possible to improve the precision of sound localization bet- 
ter than the first exanple. Note thai the scale of the circuit of the second exanple becomes slightly larger than that of 
the first example by the low-pass filter. 

Ahhough in the second example the low-pass fitter is disposed in front of the crosstalk canceling signal generating 
fifter. i.e.. on the input side, the low-pass filter can be disposed at the rear of the crosstalk canceling signal generating 
filter, i.e.. on the output side, thereby nrieddng possible the same effect 

Rg. 8 is a diagram showing a structure of a third example of the sound image localization apparatus of the first 
embodiment. As shown in the figure, this example employs a comb filter, similar to that in the first exanple. but having 
FIRs of which the number of taps is small. In the structure shown in Fig. 8. the number of taps is two. and all the coef- 
ficients can be set to. for instance. -0.46. In this case, the fiHer becomes a filter having linear phased low-pass charac- 
teristics. This sound image localization apparatus operates in a similar way to the first example. 

In an acoustic system using the sound image localization apparatus, when the distance between two loudspeakers 
is set to be short, for example, the angle the loudspeakers attain is 10 to 20 degrees, the ratio of head rdated transfer 
functions shown in Fig. 19(b). i.e.. SC/SM. becomes close to 1. Therefore, considering the stabflity of sound image 
localization, and a reduction in a high-frequency component due to the sound diffraction of a sound signal, a filter hav- 
ing a smaH number of taps has good approximation in this case. In the case, the apparatus having the structure shown 
in Rg. 8 can reduces the amount of memory required to store the coefficient further than the first example shown in Rg. 
5. As a result, the amount of data held by the delaying unrt becomes smafl. and it is possitjie to make the scale of the 
circuit smaller. 

Rgs. 9 and 1 0 are diagrams showing a structure of a fourth example of the sound image localization of the second 
en*odiment. As shown in Rg. 9, this exanple of the sound image localization apparatus includes a third example of 
the apparatus, and further conprises high-frequency main^ath fnters 917a and 917b. subsampling circuits 915a and 
915b and band compositing circuits 916a and 916b These are similar to those shown in the second example of the 
first embodiment, i.e.. the high-frequency nwin-path filters 11 7a and 11 7b. the subsampling circuits 11 5a and 1l5b.and 
the band compositing circuits 1 16a and 1 16b. The same with high-frequency main-path filters 1017a and 1017b. sub- 
sampling drcurts 1015a and 1015b. and band compositing circuits 1016a and 1016b. shown in Rg. 10. 

As to the operation of this exairple of the sound image localization apparatus. si*)sampfing and band composition 
are similar to those in the first enPodiment and the other processes are similar to those in the second embodiment. 
Therefore, similar to the second example in the first embodiment and the third example in the first enPodiment ttiis 
exanple of the sound image localization apparatus can reduce the required amount of memory and make the scale of 
the circuit sfUcitler 

The crosstalk canceling signal generating filter as the FIR filter having two taps similar to the third example is dis- 
posed between the direction localizing filter and the band conpositing circuit in the structure shown in Fig. 9, while 
being disposed at the rear of the band compositing circuit, i.e.. on the output side, in the structure shown in Rg. 10. 
However, the crosstalk canceling signal generating filter may be disposed in front of the subsampling circuit, i.e., on the 
input side, or between the subsampling circuit and the direction localizing filter, and may receive only the low-frequency 
component output from the subsampling circuit as the target of processing, resulting in the similar effect. 

As desaibed above, the sound image localization apparatus in accordance wrth the second embodiment includes 
the comb filters in which the coeffidents of the multipliers 510x1 to 510x10 shown in Rg. 5 are the same, whereby the 
operation using the filters requires only one parameter, i.e.. the coefficient, and therefore, the amount of memory for 
holding the coeffident is reduced while making possible a high level of sound image localization. 

Although in the second embodiment the outline of the structure is the same as the feedback type sound image 
localization apparatus shown in Rg. 18. the feedfonward type sound image localization apparatus shown in Fig. 17(b) 
may be used, or a comb filter can be used for the sound image localization apparatus of the first embodiment shown in 
Fig. 1(b). resulting in the same effect. 

[Embodiment 3] 

A sound image localization apparatus in accordance wrth a third enrtxxJiment of this invention employs a drcuit 
including delay buffers and accumulation registers (or memories) instead of con* filters of the second embodiment. 

Fig 1 1 is a Wock diagram showing a structure of the sound image localization apparatus of the third embodiment. 
The outline of the structure of the sound image localization apparatus of the third embodiment includes the same feed- 
back structure as the prior art shown in Rg. 18. similar to the second embodiment- As shown in Rg. 1 1. the sound 
image localization apparatus comprises adders 1 103a. 1 103b. 1 103c. and 1 103d. main-path filters 1 107a and 1 107b, 
crosstalk-path filters 1108a and 1108b. delaying units 1111a to 1111j. and multipliers lllOfI to 1110f4. 1110x1^ 
1 1 10x5. 1 1 10x6. and 1 1 10x10. Input sound signals are input through input terminals 1 104a and 1 104b. and subjected 
to signal processing, and the resulting signals are output through output terminals 1105a and 1105b. As in Rg. 2, 
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dashed lines in the rows of the delaying units represent an arbitrary number of the delaying units. 

In the figure, the portion including the adder 1 1 03c. the multipliers 1 11 Of 1 and 1 1 1 0f2. and the delaying unit 1111m. 
and the portion including the adder 1103d. the multipliers 1110f3 and 1110f4, and the delaying unit 111 In constitute 
low-pass filters similar to that in the second example of the second embodiment. In place of the comb filters constituting 
the crosstalk canceling signal generating filters (1806a and 1806b in Fig. IS), thie delaying units 1111a. 1111b. 1111c 
to llllf. and llllg to 1111j. the multipliers 1110x1, 1110x5. 1110x6. and 1110x10, and the adders 11 03e to 1103h 
are included in the sound image localization apparatus of the third embodiment. 

The comb filter included in the apparatus of the second embodiment shown in Rg. 5 perfornr^ the operation equiv- 
alent to calculating the average of data held in the delaying units 51 1 c to 51 If at a time so as to generate a crosstalk 
canceling signal at the time. Accordingly, based on the crosstalk canceling signal obtained at a certain time, the oldest 
among the data is reduced to one n-th. and one n th of the newest data is added to the data. Thereby, a crosstalk can- 
celing signal at a next time is obtained. 

In the sound image localization apparatus shown in Fig. 1 1 . the delaying units 1 1 1 la and 1 1 1 1 b hold immediately 
previous signals. Among data held by the delaying units llllcto llllf and llllg to llllj. the oldest data, i.e.. the 
data held in the delaying units llllf and llllj having maximum delay In Fig. 1 1 . are multiplied by one n-th in the mul- 
tipliers 1 1 1 0x5 and 1 1 1 0x1 0. and the results are subtracted from the immediately previous signals by the adders 1 1 03g 
and 1 103h, respectively Among the data held by the delaying units, ttie newest data. i.e.. the data held in the delaying 
units 1111c arKf llllg having minimum delay in Rg. 11, are multiplied by one n-th in the multipliers 1110x1 and 
1 1 10x6, and the results are added to tfie results of the subtraction by the adders 1 103e and 1 103f. The results of the 
additk>n are crosstalk canceling signals similar to that is obtained from the operation of the comb filter. The generated 
signals are held by the delaying units 1111a and 1 1 1 1 b to generate signals at a next time. 

In the sound image localization apparatus of the third embodiment, the data held in the delaying units 111 1c to 
llllf and 1 1 1 1g to 1 1 1 1 j are accessed only when the oldest data are taken and when the newest data are written. 
Since the delaying unit included in the comb fitter of the second embodiment is frequently accessed, a high-speed 
memory is required. In contrast, a relatively low-speed memory can be employed for the delaying unit included in the 
third embodiment. The amounts of multiplication and addition are further reduced in the third errixxJiment than in the 
second embodiment. Thus, the sound image localization apparatus in accordance with the third emlxxliment solves the 
access time problem of a memory, i.e.. (C) of the first prol)lem. and the processing speed problem, i.e., the secorxJ 
problem. 

As explained above, the sound image localization apparatus of the third embodiment includes delay buffers (the 
delaying units 1 1 1 1c to 1 1 1 1f and 1 1 1 1g to 1 1 1 1j in Rg. 1 1) and accumulation registers (the delaying units 1111a and 
1111b in Fig. 1 1) as filters for crosstalk cancellation in place of the comb filter. Thereby, the Incidence of access to a 
memory arKf the loads of addition and multiplication are reduced. As a result, in a computer system implementing the 
sound image localization apparatus, even when the anKHjnt of a high-speed memory and the processing speed of a 
processor are limited, a high level of sound image localization is possible. 

Similar to the first entxxJiment, ttie outline of the structure in the third embodiment is the same feedback type 
sound image localization apparatus as shown in Rg. 18. However, the feedforward type apparatus shown in Fig. 17 (b) 
is possible, and a circuit substituting the comb filter can be employed in the apparatus of the first emtxxiiment shown in 
Fig. 1(b). 

[Embodiment 4J 

A sound image localization apparatus in accordance with a fourth embodiment of this invention can localize a 
sound image by switching the apparatus to feedforward or feedback. 

Rg. 12 is a diagram showing a structure of a first example of the sound image localization apparatus of the fourth 
embodiment. As shown in the figure, ttie sound image localization apparatus comprises the apparatus shown in Fig. 18 
and. further, adders 1203c and 1203d, and switches 1218a and 1218b. 

Fig. 12 shows a case where the switches 1218a and 1218b both turn to feedback (an FB side in the figure). In this 
situation, crosstalk canceling signals generated by aosstalk canceling signal generating filters 1206a and 1206b are 
input to ttie adders 1203a and 1203b. That is, the crosstalk canceling signal is output to ttie input side, so the apparatus 
is a feedback type, and is equivalent to the apparatus shown in Fig. 18. In this case, the apparatus of ttie fourth embod- 
iment operates in a similar way to ttie apparatus of the second example in ttie BACKGROUND IN THE INVENTION 
section. 

As opposed to this, when the switches 1218a and 1218b both turn to feedfonward (an FF side in the figure), cross- 
talk canceling signals generated by crosstalk canceling signal generating filters 1206a and 1206b are input to the 
adders 1203c and 1203d. That is. the crosstalk canceling signal is output to the output side, so the apparatus is a feed- 
fonward type, and equivalent to the apparatus shown in Fig. 17(b). In this case, the apparatus of the fourtti embodiment 
operates in a similar way to ttie apparatus of the second exanrple in ttie BACKGROUND IN THE INVENTION section. 
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In general, the feedback type apparatus has good reproducibility of the low-frequency conponem. However, as 
described about the third problem in the prior art. when a loudspeaker included in an acoustic system using the sound 
imag tocalization apparatus is small in diameter, the large energy of the low-frequency component causes sound dis- 
tortion The feedfonwaid type apparatus has high-pass frequency characteristics which cut off the low-frequency com- 
ponent and is suited to that system. Accordingly, the sound image localization apparatus of the fourth en^odiment 
switches a feedback or feedfonward type apparatus by the switches, so that when a loudspeaker with a large diameter 
is used the apparatus operates as a feedback circuit so that good sound quaFrty can be reproduced, whne when a toud- 
speaker with a small diameter is used, the apparatus operates as a feedfonward circuit so as to prevent sound distortion. 

Thus, the sound image localization apparatus of the fourth embodiment includes the switehes 1218a and 1218b. 
thereby becoming suited to an acoustic system, to which the apparatus is appHed. by switching feedback and feedfbr- 
wHrd 

Rg. 13 is a diagram showing a structure of a second example of the sound image localization apparatus of the 
fourth embodiment. Fig. 14 is a diagram showing a structure of a third example of the sound image localization appa- 
ratus of the fourth embodiment. As shown in Rg. 13. the second example of the apparatus is the apparatus according 
to the first entxxliment that crosstalk canceOation is perfomied on the input skle. and further that switches are added. 
The third example of the apparatus shown in Rg. 14 comprises the feedback type apparatus in Fig. 18 and. further, 
switches as the first example does. Whfle in the first example the swrtches are disposed at the rear of the crosstalk can- 
celing signal generating frtter. i.e.. on the output side, in the third example the switches are disposed in front of the filter, 
i.e.. on the input side. The second and third examples of the sound image locaKzation apparatus shown in Rgs. 13 and 
14 can be suited to an acoustic system by switching feedback and feedfonward. 

[Embodiment 5] 

A sound image localization apparatus in accordance with a fifth embodiment has capabiUty of changing an initial 
delay in generating a crosstalk canceling signal. ... -a, 

Rg 15 is a diagram showing a structure of the sound image localization of the fifth embodiment. As showvn in the 
figure, the sound image localization of the fifth embodiment is such that delaying units 151 la to 151 Id and switches 
1 51 8a and 1 518b are added to the feedback type apparatus shown in Rg. 18. ,- • , 

In the situation shown in Rg. 15, the switches 1518a and 1518b are set m a way that the crosstalk canceling signal 
generating filters 1506a and 1506b output generated signals to the adders 1503b and 1503a without passing the sig- 
nals through the delay units. In this situation, the sound image kxalization of the fifth embodiment is equivalent to the 
apparatus shown in Rg. 18. The sound image localization apparatus of the fifth embodiment wittn this setting operates 
in a similar way to the second example in the prior art. ... a_ 

The sound image kxalization apparatus can use delayed crosstalk canceling signals held in the delaying units 
1 51 lb and 1 51 Id. or delayed crosstalk canceling signals heW in the delaying unHs 1 51 1 a and 151 1c. depending on the 
setting of the switches 1518a and 1518b. respectively The sound image kxalization apparatus of the fifth embodiment 
with this setting operates in a similar way to that described in the first entiodiment. except that the delayed crosstalk 
canceling signal is used for crosstalk cancellation. . . ,. ^ ^ «• ■ . 

In calculation by the crosstalk canceling signal generating fflter. the input signal is mulbplied by the coefficient 
shown in the equation 7-3. representing the ratio of the head related transfer functions SC and SM shown in Rg. 19(b). 
As is apparent from Rg. 1 9(b). as the crosstalk path is longer than the main path; there occurs a difference in the times 
of arrivals of sound signals from two loudspeakers. When the angle of the two toudspeakers is small, the difference in 
the arrival time is small. When the angle is large, the difference in the arrival time is large. This must be taken into 
account for sound image localization. In the crosstalk canceling signal generating filter, the arrival time difference is 
equivalent to the amount of an initial delay Therefore, in an acoustic system using a sound image localization appara- 
tus, when the fixed amount of an inHial delay is used. H the positions of setting up the loudspeakers are changed, cross- 
talk cancellation is not possibly satisfactory ^ ^ 

In the crosstalk canceling signal generating filter, in cases except for initial delay, the frequency characteristics do 
not change to a large extent if the angle of two loudspeakers is around 30 to 60 degrees. The change in the angle can 
be coped with by swHching initial delays. The sound image localization apparatus of the fiffli embodiment can change 
the amount of an initial delay in a st^y-step manner by setting of the switches. 

As described above, the sound image localization apparatus in accordance wHh the fifth embodiment further 
includes the delaying units 1 51 1 a to 1 51 Id and the switches 1 518a and 151 8b. thereby perfomiing a high level of sound 
image localization by coping with a case where the angle of two loudspeakers are changed in an acoustic system to 
which the apparatus is applied. 
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[Embodiment 6] 

A sound image localization apparatus in accordance with a sixth embodiment changes a aosstalk canceling signal 
generating filter. 

5 Fig. 16 is a block diagram showing a structure of the sourxJ image localization apparatus of the sixth embodiment. 

As shown in the figure, the sound image localization apparatus comprises main-path filters 1 607a and 1 607b, crosstalk- 
path filters 1608a and 1608b. adders 1603a to 1603f. crosstalk canceling signal generating filters 1606a and 1606b. 
delaying units 161 la to 161 Id. multipliers 1610x1 to 1610x4. inverting circuits 1631a and 1631b. and switches 1618a 
to 1618f. The apparatus receives input sound signals through input terminals 1604a to 1604d. and outputs processed 
10 signals through output terminals 1 605a and 1 605b. 

The delaying units 161 la and 161 lb. the multipliers 1610x1 and 1610x2. and the adder 1603c constitute a first FIR 
fitter having two taps. The delaying units 1611c and 161 Id, the multipliers 1610x3 and 1610x4, and the adder 1603d 
constitute a second FIR filter having two taps. Either filter functions as a crosstalk canceling signal generating filter. The 
switches 1618a to 1618f are witched depending on the distance between two loudspeakers of an acoustic system 
15 using the sound image localization apparatus. 

The main-path filters I607aand 1607b, the crosstalk-path fnters 1608a and 1608b. the adders 1603a to 1603d, and 
the crosstalk canceling signal generating filters 1 606a and 1 606b are simileir to those of the feedback type sound image 
localization apparatus shown in Figs. 1(a) and 1(b). 

The operation of the sound image localization apparatus of the sixth embodiment will be described as to when the 
20 distance between two loudspeakers is wide or narrow. 

At first, when the distance between two loudspeakers is wide, the switches 1618a. 1618b. 1618e, and 1618f are 
set to respective W sides, while the switches 1 61 Be and 161 8d are set to be released. This is the situation shown in the 
figure. In this case, sound signals input through the input terminals 1604c and 1604d are output to the output terminals 
1605a and 1606b. passing through the sound image localization apparatus of the sixth embodiment. 
25 Signals input through the input terminals 1 604a and 1 604b are subjected to directional localization, and then, input 
through the switches 1618a and 1618b to the crosstalk canceling signal generating filters 1606a and 1606b. Thereafter, 
signals output from the first and second FIR filters each having two taps are not used because the switches 1618c and 
1618d are released. Therefore, the operation of the apparatus is equivalent to that of the feedback type sound image 
localization apparatus shown in Rg. 18. 
30 As opposed to this, when the distance between the two loudspeakers is narrow, the switches 1 61 8a. 1 61 8b. 1 61 8e. 
and 1618f are set to N sWes. wtiile the switches 1618c and 1618d are closed. Thus, signals after subjected to direc- 
tional localization are processed by the first and second FIR filters each having two taps, and then, input through the 
switches 1618c and 1 61 8d to the adders 1603a and 1603b. That is. the first and second FIR filth's are used for crosstalk 
cancellation. 

35 On the other hand, the phases of sound signals input through the input terminals 1604c and 1604d are inverted by 
the inverting circuits 1631a and 1631b. and then, input through the switches 1618a and 1618b to the filters 1606a and 
1606b The filters 1606a and 1606b generate signals based on the phase inverted signals, and output the generated 
signals to the adders 1603a and 1603b. 

In this case, the channels to the adders 1603a and 1603b function as main paths due to the switches 1618e and 

40 I618f. while the filters 1606a and 1606b generate crosstalk canceling signals. This is effective processing when a 
sound image to be localized at the front position and a sour>d image to be localized at an arbitrary position (at the side 
or the rear) coexist in a sound signal. When the distance between two loudspeakers is narrow, if a sound image to be 
localized at the front is extended further outward, stereophony increases. 

That is. in the apparatus of the sixth en^odiment. a sound signal of the sourxj image to be localized at the arbitrary 

45 position is input through the input terminals 1604a and 1604b. while a sound signal of the sound image to be kx:alized 
at the front position is input through the input terminals 1604c and 1604d. When the distance between two loudspeak- 
ers is wide, the sound image to be localized at the front position is output as it is. while the sound innage to be localized 
at the arbitrary position is subjected to crosstalk cancellation similar to that in the first embodiment. When the distance 
between the two loudspeakers is narrow, a crosstalk canceling signal is generated for the sound image to t>e localized 

so at the front position to extend the sound image outward. On the other hand, for the sourxi image to be localized at the 
art>itrary position, the crosstalk canceling signal generating filter used for sound localization multiplies an input signal 
by the coefficient shown in the equation 7-3. representing the ratio of the head related transfer functions SC and SM 
shown in Fig. 19(b). Because the distance between the two loudspeakers is narrow, the ratio is small, so that it is pos- 
stole to use a filter having a small number of taps. Therefore, the filter having two taps is used. 

55 As descrtoed atxsve. the sound image localization apparatus of the sixth embodiment comprises the conventional 
feedljack type sound image localization apparatus and. further, the FIR filters with two taps comprising the delaying 
units 161 la to 161 Id. the nnultipliers 1610x1 to 1610x4. and the adders 1603c to 1603d. the switches 1618a to 1618d. 
and the inverting circuits 1631a and 1631b. whereby when the distance between two loudspeakers is wide, the feed- 
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back sound localization similar to that in the first ennbodiment is performed, while when the distance between two loud- 
speak^s is narrow, the outward extension of a sound image to be localized at the front is performed as well as the 
feedback sound localization. 

Note that although the apparatus of the sixth embodiment is based on the feedback type sound image localization 
apparatus shown in Rg. 18. the apparatus of the sixth embodiment can be based on the feedfonrard type apparatus 
shown in Rg. 1 7(b) or the apparatus of the first embodiment shown in Fig. 1 (b). 

Claims 

1 . A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localiring a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal, and performing crosstalk canceflation 
using the crosstalk carKeling signal; and 

direction localizing means for localizing the direction of a virtual sound source position by processing the signal 
subjected to crosstalk cancellation in said crosstalk canceling means. 

2. The sound image localization apparatus of daim 1 wherein 

said crosstalk canceling means comprise first and second crosstalk canceling signal generating filters, and first 
and second adders. sakJ first adder adding a first sound signal and a signal generated by sakJ second crosstalk 
cancefing signal generating filter, and said second adder adding a second sound signal and a signal generated 
by said first crosstalk cancefing signal generating filter; 

said direction localizing means comprise first and second main-path filters, first and second crosstalk-path f n- 
ters. and first and second adders, s^d first adder adding a signal processed by said first main-path filter and a 
sigrial processed by said second aosstalk-path filter, and said second adder adding a signal processed by said 
second main-path filter and a signal processed by said first crosstalk-path filter. 

3. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means for including a comb filter to generate the crosstalk canceling signal, and performing 

crosstalk cancellation using the crosstalk canceling signal; and 

direction localizing means for focalizing the direction of a virtual sound source position. 

4. A sound image tocalization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means for generating a crosstalk canceling signal generated at a certain time, holding the 
crosstalk canceling signal, delaying the crosstalk canceling signal hekJ. hokling the plurality of crosstalk can- 
celing signals delayed, and multiplying some of the plurality of crosstalk canceling signals heW, by a predeter- 
mined coefficient to generate the crosstalk canceling signal at a time foHowing the certain time; arxl 
direction localizing means for localizing the direction of a virtual sound source position. 

5. The sound image localization apparatus of any of daim 3 and claim 4 wherein 

said apparatus further conprises a low-pass filter processing a signal irput to or output from said crosstalk 
carKeling means. 

6. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal. 
locaFizing a virtual soutkI image, and outputting a sound image localization signal, said apparatus compnsing: 

crosstalk canceling means corr^rising a crosstalk canceling signal generating filter generating a crosstalk can- 
celing signal, and a switch switching the crosstalk canceling signal generated by sakl crosstalk canceling sig- 
nal generating filter to the output side of said crosstalk canceling signal generating filter or to the input side of 
sakJ crosstalk canceling signal generating filter; and 

direction localizing means for localizing the direction of a virtual sound source position. 
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7. A sound image localization apparatus receiving a sound signal, performing signal processing to the sound signal, 
localizing a virtual sound image, and outputting a sound image localization signal, said apparatus comprising: 

crosstalk canceling means comprising a crosstalk canceling signal generating filter generating a crosstalk can- 
5 celing signal, and a delaying unit delaying a signal input to or output from said crosstalk canceling signal gen- 

erating filter by various times: and 

direction localizing means for localizing the direction of a virtual sound source position, 

8. A sound image localization apparatus receiving an input sound signal to be localized in a first direction, and an 
10 input sound signal to be localized in a secorxJ direction, performing signal processing to the input sound signals, 

localizing virtual sound images, and outputting sound image localization signals, said apparatus comprising. 

crosstalk canceling means comprising a first filter, a second filter, and a switch switching first and second 
modes; in the first mode said first filter functioning as a filter generating the crosstalk canceling signal. arxJ in 
15 the second mode said second filter functioning as a filter generating the crosstalk canceling signal while said 

first filter functioning as a filter localizing the second direction; and 
direction localizir>g means for localizing the direction of a virtual sound source position. 
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Fig.1 (a) 
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Fig.7 (a) 
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Fig.12 
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